-- Logs begin at Mon 2022-10-17 16:57:17 UTC, end at Mon 2022-10-17 18:17:30 UTC. -- Oct 17 17:47:11.688826 dv-cinder-861609-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 17:47:11.698811 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 17:47:11 2022] *** Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: nodename: dv-cinder-861609-1-iscsi Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: machine: x86_64 Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: clock source: unix Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: pcre jit disabled Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: detected number of CPU cores: 4 Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: current working directory: / Oct 17 17:47:11.700799 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: detected binary path: /usr/bin/uwsgi-core Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: your processes number limit is 47680 Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: your memory page size is 4096 bytes Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: detected max file descriptor number: 2048 Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: lock engine: pthread robust mutexes Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: thunder lock: enabled Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 17:47:11.701416 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 17:47:11.740673 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: Python main interpreter initialized at 0x560b676409c0 Oct 17 17:47:11.740673 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: python threads support enabled Oct 17 17:47:11.740673 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: your server socket listen backlog is limited to 100 connections Oct 17 17:47:11.740673 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: your mercy for graceful operations on workers is 90 seconds Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: *** Operational MODE: preforking *** Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: *** uWSGI is running in multiple interpreter mode *** Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: spawned uWSGI master process (pid: 111033) Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: spawned uWSGI worker 1 (pid: 111034, cores: 1) Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: spawned uWSGI worker 2 (pid: 111035, cores: 1) Oct 17 17:47:11.750410 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 17:47:11.741561 dv-cinder-861609-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 17:47:12.410710 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 17:47:12.422502 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 17:47:13.526883 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:47:13.526883 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: from cryptography.utils import int_from_bytes Oct 17 17:47:13.527585 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:47:13.527585 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: from cryptography.utils import int_from_bytes Oct 17 17:47:13.561765 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:47:13.561765 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: from cryptography.utils import int_from_bytes Oct 17 17:47:13.562334 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:47:13.562334 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: from cryptography.utils import int_from_bytes Oct 17 17:47:16.038436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 17:47:16.039118 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 17:47:16.039479 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 17:47:16.039581 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 17:47:16.039669 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 17:47:16.039764 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 17:47:16.039851 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 17:47:16.039939 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 17:47:16.040025 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 17:47:16.040118 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 17:47:16.040212 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.040299 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.040478 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.040577 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.040836 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.040934 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.041157 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.041265 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.041492 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.041632 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.041803 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.041916 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.042116 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.042211 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.042440 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.042554 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.042775 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.042898 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.043084 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.043185 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.043401 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.043498 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.043729 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861609-1-iscsi {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.043825 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861609-1-iscsi {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.044049 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.044135 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.044367 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.044465 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.044702 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.044812 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045019 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045116 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045340 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045496 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045639 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045735 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.045941 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.046145 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.046436 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.046556 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.046868 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.047005 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.047172 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.047298 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.047483 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.047606 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.047811 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048004 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048192 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048345 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048450 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048543 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048741 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.048841 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.049046 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.049139 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.049364 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.049507 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.049674 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.049768 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.050071 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861609-1-iscsi {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.050157 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861609-1-iscsi {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.050385 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.050477 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.050705 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.050802 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.051001 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.051091 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.051412 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.051520 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052109 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052211 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052211 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052382 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052510 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052685 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052865 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.052960 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.053177 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.053284 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.053502 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.053593 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.053822 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.053917 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.054139 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.054241 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.054457 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.054551 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.054756 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.054852 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055062 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055156 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055366 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055477 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055685 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055834 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.055986 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056080 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056291 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056402 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056535 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056655 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056870 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.056974 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.057190 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.057280 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.057508 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.057603 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.057825 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.057927 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058074 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058184 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058320 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058415 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058632 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058725 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.058947 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059043 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059252 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059339 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059562 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059648 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059865 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.059981 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.060169 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.060262 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.060474 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.060569 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.060803 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.060894 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.061108 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.061194 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.061410 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.061499 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.061725 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.061818 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062034 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062119 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062348 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062439 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062657 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062768 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.062975 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.063072 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.063367 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.063456 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.063614 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.063716 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.063922 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064010 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064255 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064350 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064569 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064703 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064900 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.064998 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.065216 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.065305 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.065531 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.065627 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.065836 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066031 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066121 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066206 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066453 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066560 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066743 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.066829 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.067076 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.067282 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.067431 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.067590 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.067822 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068020 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068020 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068170 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068257 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068346 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068538 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068667 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068872 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.068958 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.069178 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.069273 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.069505 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.069611 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.069783 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.069884 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.070127 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.070234 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.070393 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.070488 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.070698 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.070800 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071000 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071092 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071302 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071397 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071604 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071706 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071903 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.071988 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.072204 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.072288 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.072504 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.072622 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.072834 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.072931 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.073145 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.073229 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.073463 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.073549 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.073770 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.073855 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074070 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074164 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074372 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074466 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074674 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074768 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.074988 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.075072 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.075291 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.075388 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.075593 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.075678 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.075907 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076037 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076208 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076303 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076508 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076621 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076848 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.076934 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.077150 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.077237 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.077452 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.077536 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.077764 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.077858 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078061 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078147 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078363 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078446 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078673 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078757 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.078973 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079059 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079275 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079358 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079578 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079664 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079877 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.079969 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.080175 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.080269 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.080474 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.080567 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.080796 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.080882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.081097 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.081190 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.081391 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.081489 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.081703 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.081788 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.082003 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.082088 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.082307 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.082400 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.082653 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.083357 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.084086 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.084194 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.084323 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.084429 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:47:16.084511 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.084609 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.084840 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.085189 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.085507 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.085840 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.086173 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.086344 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.086493 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.086767 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.086881 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.087035 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.087128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.087377 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.087462 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.087710 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.087808 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088023 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088116 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088332 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088424 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088670 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088762 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.088990 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.089075 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.089300 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.089395 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.089614 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.089713 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.089928 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090014 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090242 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090328 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090555 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090652 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090876 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.090969 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.091190 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.091274 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.091507 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.091592 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.091819 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.091904 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.092126 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.092221 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.092446 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.092533 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.092811 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.092896 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.093128 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.093213 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.093440 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.093528 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.093755 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.093840 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.094066 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.094151 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.094376 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.094469 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.094711 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.094805 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095025 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095123 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095337 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095428 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095649 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095734 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.095959 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.096055 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.096276 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.096361 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.096586 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.096716 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.096918 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097024 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097230 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097317 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097540 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097627 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097846 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.097940 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.098158 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.098244 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.099100 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.099269 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.099772 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.099856 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.099988 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100072 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100150 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100235 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100324 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100403 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100558 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100690 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.100891 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101024 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101201 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101340 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101505 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101655 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101810 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.101974 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.102115 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.102287 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.102425 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.102600 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.102729 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.102911 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.103075 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.103217 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.103357 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.103523 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.103670 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.103831 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104004 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104141 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104312 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104446 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104654 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104792 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.104968 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.105121 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.105278 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.105429 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.105581 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.105761 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.105891 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.106067 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.106201 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.106382 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.106506 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.106693 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.106827 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107004 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107136 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107309 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107440 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107621 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107762 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.107931 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.108065 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.108236 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.108372 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.108558 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.108710 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.108895 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109024 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109200 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109333 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109523 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109645 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109830 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.109954 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.110137 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.110273 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.110453 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.110583 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.110770 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.110892 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.111083 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.111224 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.111396 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.111553 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.111706 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.111856 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.112030 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.112178 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.112339 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.112500 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.112672 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.112843 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113009 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113148 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113339 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113463 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113645 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113766 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.113971 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.114102 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.114617 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.114773 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.114855 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.114947 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.115110 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.115197 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.115421 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.115507 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.115726 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.115830 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116032 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116119 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116337 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116425 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116676 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116778 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.116982 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117075 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117283 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117367 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117585 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117678 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117883 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.117974 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.118186 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.118270 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.118507 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.118594 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.118817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.118903 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.119119 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.119205 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.119423 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.119510 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.119725 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.119810 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.120065 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.120151 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.120370 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.120458 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.120706 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.120795 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121024 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121108 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121336 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121424 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121649 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121736 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.121968 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122112 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122281 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122368 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122588 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122672 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122894 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.122987 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.123200 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.123285 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.123510 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.123603 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.123830 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.123924 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.124137 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.124223 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.124452 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.124538 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.124790 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.124887 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.125121 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.125239 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.125428 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.125516 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.125743 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.125829 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126046 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126131 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126357 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126487 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126667 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126755 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.126976 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.127062 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.127286 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.127375 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.127595 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.127683 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.127911 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128003 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128221 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128307 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128529 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128637 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128861 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.128947 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.129169 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.129297 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.129477 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.129570 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.130341 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.130813 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.130813 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.130979 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.130979 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.131132 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.131211 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.131376 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.131543 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.131710 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.131852 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132021 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132169 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132333 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132475 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132713 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132830 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.132975 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.133128 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.133287 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.133461 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.133598 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.133773 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.133905 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.134087 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.134205 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.134406 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.134514 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.134717 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.134826 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135026 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135137 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135338 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135439 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135643 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135729 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.135949 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.136036 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.136265 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.136376 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.136572 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.136678 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.136916 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137033 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137295 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137397 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137531 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137627 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137842 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.137939 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.138148 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.138234 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.138452 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.138539 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.138756 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.138850 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139058 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139142 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139375 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139473 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139681 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139774 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.139985 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.140071 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.140291 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.140376 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.140620 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.140723 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.140922 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141008 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141247 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141332 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141548 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141642 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141850 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.141934 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.142155 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.142290 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.142459 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.142554 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.142769 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.142854 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.143079 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.143164 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.143385 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.143478 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.143702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.143793 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144020 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144112 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144326 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144418 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144663 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144755 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.144975 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.145060 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.145339 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146358 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146358 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146592 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146673 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146750 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146867 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.146954 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.147182 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.147268 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.147498 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.147592 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.147806 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.147893 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.148119 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.148213 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.148438 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.148531 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.148811 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.149038 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.149125 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.149376 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.149461 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.149695 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.149782 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.150014 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.150101 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.150609 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.150715 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.150932 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.151179 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.151267 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.151525 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.151610 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.151876 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.151971 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.152186 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.152281 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.152500 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.152586 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.152835 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.152931 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.153145 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.153239 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.153459 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.153574 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.153766 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.153893 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154076 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154243 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154383 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154578 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154695 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154891 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.154985 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.155221 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.155308 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.155545 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.155639 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.155872 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.155971 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.156187 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.156281 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.156495 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.156691 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.156836 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.156930 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.157140 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.157229 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.157445 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.157537 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.157753 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.157850 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158055 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158142 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158359 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158445 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158663 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158751 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.158974 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.159067 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.159283 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.159370 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.159610 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.159704 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.159926 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.160014 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.160233 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.160319 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.160540 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.160648 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.160897 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.161085 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.161320 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.161417 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.161548 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.161640 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162010 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162113 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162245 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162383 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162539 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162731 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.162847 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163040 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163151 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163351 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163462 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163678 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163764 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.163986 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.164081 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.164296 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.164383 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.164637 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.164728 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.164940 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165039 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165253 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165340 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165557 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165689 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165863 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.165956 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.166167 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.166265 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.166470 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.166556 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.166780 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.166874 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167084 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167169 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167387 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167475 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167690 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167784 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.167989 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.168074 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.168302 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.168387 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.168618 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.168707 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.168926 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169013 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169225 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169316 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169536 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169622 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169840 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.169923 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.170142 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.170234 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.170442 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.170528 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.170759 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.170854 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171062 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171155 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171364 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171449 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171669 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171761 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.171975 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.172179 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.172268 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.172348 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.172569 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.172730 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.172914 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173015 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173227 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173313 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173528 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173613 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173833 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.173926 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.174142 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.174226 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.174444 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.174528 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.174744 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.174831 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175050 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175136 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175349 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175435 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175747 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.175955 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.176041 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.176259 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.176345 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.176664 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177113 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177113 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177294 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177375 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177526 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177628 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177839 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.177927 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.178146 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.178232 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.178452 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.178547 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.178757 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.178844 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.179061 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.179147 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.179366 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.179455 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.179689 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.179776 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180002 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180095 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180303 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180389 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180615 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180704 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.180929 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181063 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181233 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181322 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181548 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181641 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181858 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.181944 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.182172 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.182258 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.182479 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.182565 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.182783 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.182881 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.183101 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.183186 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.183407 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.183493 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.183716 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.183809 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184021 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184108 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184337 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184423 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184672 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184775 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.184981 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185067 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185285 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185370 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185590 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185691 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185895 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.185979 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.186205 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.186291 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.186514 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.186601 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.186820 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.186905 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.187132 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.187226 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.187442 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.187530 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.187749 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.187850 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188051 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188138 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188358 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188447 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188689 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188787 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.188998 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.189084 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.189302 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.189389 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.189610 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.189694 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.189917 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190009 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190221 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190307 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190529 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190614 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190830 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.190922 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.191140 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.191227 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.191445 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.191531 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.191751 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.191872 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.192057 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.192788 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193334 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193422 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193497 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193586 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193667 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193745 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193912 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.193999 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.194228 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.194324 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.194549 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.194637 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.194853 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.194941 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.195271 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.195359 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.195583 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.195668 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.195892 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.195976 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.196194 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.196283 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.196495 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.196580 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.196824 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.196911 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.197137 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.197263 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.197451 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.197537 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.197753 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.197848 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198058 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198195 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198363 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198450 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198682 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198781 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.198987 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.199074 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.199305 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.199398 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.199641 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.199735 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.199958 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.200063 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.200282 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.200368 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.200608 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.200711 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.200918 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201005 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201223 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201318 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201552 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201639 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201858 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.201943 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.202180 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.202276 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.202518 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.202610 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.202829 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.202925 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.203136 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.203223 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.203458 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.203579 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.203781 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.203889 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.204092 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.204186 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.204411 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.204497 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.204745 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.204836 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.205067 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.205155 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.205386 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.205471 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.205698 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.205787 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206017 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206105 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206336 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206430 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206661 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206747 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.206971 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.207103 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.207293 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.207418 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.207591 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.207679 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.208762 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.208865 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.208947 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209042 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209200 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209290 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209528 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209659 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209853 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.209949 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.210178 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.210272 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.210487 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.210574 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.210800 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.210895 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.211113 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.211200 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.211423 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.211515 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.211730 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.211826 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212034 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212170 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212342 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212429 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212673 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212777 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.212997 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.213085 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.213303 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.213397 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.213617 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.213704 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.213928 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214014 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214231 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214325 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214532 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214619 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214837 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.214923 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.215151 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.215245 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.215452 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.215537 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.215754 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.215839 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.216071 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.216176 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.216389 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.216474 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.216730 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.216818 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217039 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217175 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217366 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217496 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217675 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217792 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.217982 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.218096 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.218280 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.218368 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.218642 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.218742 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.218922 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219010 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219225 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219311 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219547 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219640 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219850 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.219936 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.220156 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.220250 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.220468 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.220561 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.220797 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.220887 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.221101 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.221187 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.221406 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.221507 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.221717 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.221803 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222019 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222105 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222323 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222467 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222627 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222714 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.222933 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.223022 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.223235 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.223328 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.223623 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224061 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224160 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224250 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224331 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224424 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224505 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224664 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224794 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.224972 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.225134 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.225276 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.225438 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.225581 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.225765 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.225902 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.226078 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.226206 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.226402 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.226528 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.226718 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.226838 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227036 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227125 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227353 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227442 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227667 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227761 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.227984 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.228130 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.228302 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.228398 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.228636 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.228785 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.228953 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229040 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229272 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229359 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229588 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229686 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229903 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.229989 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.230217 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.230439 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.230533 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.230772 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.230859 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.231089 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.231177 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.231406 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.231493 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.231721 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.231809 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.232037 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.232122 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.232350 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.232460 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.232684 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.232772 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233001 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233219 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233311 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233555 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233650 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233873 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.233960 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.234192 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.234285 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.234507 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.234604 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.234824 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.234909 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.235140 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.235240 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.235455 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.235542 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.235766 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.235851 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.236075 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.236169 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.236388 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.236475 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.236740 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.236831 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237049 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237136 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237364 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237449 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237681 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237768 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.237996 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.238083 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.238307 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.238393 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.238618 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.238708 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.238931 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.239074 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.239379 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.239700 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.239864 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.239994 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.240087 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.240314 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.240482 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.240653 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.240841 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.240971 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.241162 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.241285 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.241487 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.241598 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.241823 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.241992 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.242148 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.242234 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.242463 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.242556 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.242781 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.242875 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.243096 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.243182 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.243406 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.243618 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.243713 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.243936 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.244048 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.244269 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.244355 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.244646 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.244756 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.244946 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.245041 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.245265 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.245358 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.245584 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.245800 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.245909 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.246116 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.246202 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.246448 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.246542 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.246774 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.246860 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.247098 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.247185 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.247400 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.247544 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.247722 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.247817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.248032 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.248127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.248336 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.248429 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.248666 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.248767 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249035 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249135 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249290 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249512 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249601 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249858 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.249944 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.250173 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.250273 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.250496 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.250582 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.250817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.250910 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.251126 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.251222 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.251431 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.251657 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.251744 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252008 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252104 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252323 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252416 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252666 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252816 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.252982 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253079 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253289 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253377 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253593 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253678 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253901 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.253996 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.254210 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.254295 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.254516 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.255143 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.255695 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.255801 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.255886 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.255973 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256060 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256146 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256260 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256390 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256565 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256725 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.256893 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257028 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257206 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257335 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257511 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257643 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257817 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.257936 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.258120 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.258264 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.258423 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.258572 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.258732 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.258879 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259036 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259185 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259344 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259494 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259800 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.259961 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.260105 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.260315 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.260402 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.260647 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.260755 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.260954 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261042 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261276 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261361 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261581 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261674 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261886 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.261973 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.262202 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.262296 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.262513 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.262608 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.262835 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.262921 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.263147 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.263234 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.263458 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.263552 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.263785 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.263877 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.264092 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.264177 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.264409 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.264649 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.264738 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.264990 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.265077 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.265312 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.265409 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.265644 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.265775 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.265975 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.266061 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.266284 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.266380 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.266591 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.266813 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.266907 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.267147 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.267234 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.267467 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.267554 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.267798 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.267883 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.268106 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.268199 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.268417 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.268498 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.268754 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.268842 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269062 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269209 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269370 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269456 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269682 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269769 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.269990 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.270084 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.270349 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271092 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271360 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271472 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271583 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271674 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271759 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.271843 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.272048 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.272139 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.272357 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.272458 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.272688 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.272781 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273000 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273091 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273311 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273411 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273621 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273718 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.273931 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274030 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274240 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274336 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274550 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274646 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274859 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.274955 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.275170 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.275523 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.275750 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.275839 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.276062 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.276160 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.276381 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.276472 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.276719 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.276824 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.277031 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.277341 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.277428 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.277650 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.277739 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.277972 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.278084 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.278374 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.278472 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.278604 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.278683 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.278909 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.279010 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.279262 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.279580 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.279671 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.279895 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.279992 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.280207 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.280295 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.280535 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.280669 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.280876 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281023 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281201 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281319 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281527 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281641 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281836 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.281977 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.282141 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.282228 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.282447 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.282536 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.282801 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283028 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283118 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283200 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283379 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283470 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283684 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283776 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.283989 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.284079 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.284295 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.284383 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.284615 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.284718 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.284920 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285010 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285228 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285336 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285530 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285621 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285830 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.285974 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.286159 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.286259 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.286464 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.286553 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.286767 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.286854 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287072 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287169 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287376 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287464 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287680 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287768 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.287989 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.288087 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.288292 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.288393 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.288612 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.288756 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.288920 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289024 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289222 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289348 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289523 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289611 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289826 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.289929 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.290141 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.290230 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.290447 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.290536 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.290752 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.290843 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291095 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291198 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291360 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291542 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291663 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291859 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.291993 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.292183 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.292324 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.292504 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.292666 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.292847 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.292991 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.293160 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.293303 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.293495 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.293626 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.293806 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.293935 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.294118 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.294255 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.294457 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.294578 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.294749 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.294890 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.295060 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.295201 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.295370 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.295531 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.295681 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.295844 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296006 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296155 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296314 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296467 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296660 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296809 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.296978 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.297118 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.297296 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.297430 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.297612 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.297743 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.297922 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.298083 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.298352 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.298443 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.298666 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.298756 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.298976 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299075 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299284 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299375 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299596 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299687 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299907 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.299997 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.300223 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.300312 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.300531 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.300637 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.300867 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.300958 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.301175 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.301264 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.301508 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.301654 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.301890 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.302019 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.302211 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.302352 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.302523 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.302777 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.302869 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.303110 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.303200 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.303438 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.303531 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.303764 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.303869 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.304083 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.304171 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.304390 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.304477 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.304743 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.304852 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305071 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305162 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305384 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305485 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305692 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305781 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.305936 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 17:47:16.306034 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.306351 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.306665 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.306977 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.307283 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:47:16.307525 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 17:47:16.463252 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO dbcounter [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Registered counter for database nova_api Oct 17 17:47:16.465429 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO dbcounter [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Registered counter for database nova_api Oct 17 17:47:16.485442 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_db.sqlalchemy.engines [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.487002 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_db.sqlalchemy.engines [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.493016 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writer thread running {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.494103 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writer thread running {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.550250 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.context [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),055a56ef-b612-4d83-a035-3bdaaf8bd0d1(cell1) {{(pid=111034) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 17:47:16.552491 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.context [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),055a56ef-b612-4d83-a035-3bdaaf8bd0d1(cell1) {{(pid=111035) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 17:47:16.554761 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_concurrency.lockutils [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:47:16.555273 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_concurrency.lockutils [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:47:16.556334 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:47:16.556841 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:47:16.556964 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_concurrency.lockutils [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:47:16.557702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_concurrency.lockutils [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:47:16.558166 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_concurrency.lockutils [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:47:16.558437 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:47:16.559165 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:47:16.559645 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:47:16.560238 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_concurrency.lockutils [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:47:16.561703 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:47:16.562373 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO dbcounter [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Registered counter for database nova_cell0 Oct 17 17:47:16.563720 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO dbcounter [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Registered counter for database nova_cell0 Oct 17 17:47:16.566647 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO dbcounter [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Registered counter for database nova_cell1 Oct 17 17:47:16.568358 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO dbcounter [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Registered counter for database nova_cell1 Oct 17 17:47:16.575453 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_db.sqlalchemy.engines [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.576803 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_db.sqlalchemy.engines [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.579216 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_db.sqlalchemy.engines [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.580608 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_db.sqlalchemy.engines [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.582315 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writer thread running {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.586820 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writer thread running {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.592062 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writer thread running {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.725219 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writer thread running {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.734969 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO dbcounter [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Registered counter for database nova_cell0 Oct 17 17:47:16.735974 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO dbcounter [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Registered counter for database nova_cell0 Oct 17 17:47:16.745251 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_db.sqlalchemy.engines [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.747122 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG oslo_db.sqlalchemy.engines [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:47:16.750231 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writer thread running {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:16.752944 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writer thread running {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:47:17.171347 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: WARNING keystonemiddleware.auth_token [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:47:17.179335 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: WARNING keystonemiddleware.auth_token [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:47:17.190782 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: WARNING keystonemiddleware.auth_token [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:47:17.198301 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: WARNING keystonemiddleware.auth_token [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:47:17.522359 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: WARNING keystonemiddleware.auth_token [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:47:17.528558 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: WARNING keystonemiddleware.auth_token [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:47:17.533850 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b676409c0 pid: 111035 (default app) Oct 17 17:47:17.535958 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:47:17.537234 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001867 Oct 17 17:47:17.537649 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Mon Oct 17 17:47:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:47:17.546026 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: WARNING keystonemiddleware.auth_token [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:47:17.553422 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: WARNING keystonemiddleware.auth_token [None req-7677c386-f01a-4cfc-a2da-1d132335fe60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:47:17.558721 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b676409c0 pid: 111034 (default app) Oct 17 17:48:43.558004 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:48:43.559014 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Oct 17 17:48:43.560869 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:48:43.577339 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_api:SELECT=3 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:43.579198 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_cell0:SELECT=3 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:43.580209 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_cell1:SELECT=3 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:43.580974 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:44.459921 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-709ef70d-cf83-4bff-b7ad-f94dec313a99 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:48:44.492680 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-709ef70d-cf83-4bff-b7ad-f94dec313a99 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.924667 Oct 17 17:48:44.493432 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 17 17:48:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:48:47.151628 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:48:47.152643 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-44c70c01-8438-4568-bd62-bcc0ba8e88fd None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 17 17:48:47.153211 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:48:47.630616 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-58b13a6c-5f82-47b1-8565-cfe786b83537 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:47.733452 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-58b13a6c-5f82-47b1-8565-cfe786b83537 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.573683 Oct 17 17:48:47.734004 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:48:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 17:48:47.748778 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_api:SELECT=3 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:47.749720 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_cell0:SELECT=3 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:47.752667 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_cell1:SELECT=3 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:47.754291 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:48:47.967665 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-f9611d16-edeb-4371-8bf6-45d422a7c179 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:48.469186 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-f9611d16-edeb-4371-8bf6-45d422a7c179 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.725481 Oct 17 17:48:48.470340 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 17 17:48:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:48:51.191612 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-58b13a6c-5f82-47b1-8565-cfe786b83537 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:48:51.192760 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-58b13a6c-5f82-47b1-8565-cfe786b83537 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Oct 17 17:48:51.193161 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:48:51.906155 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-668dee31-2931-46e5-86df-c4965c457642 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:52.017830 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-668dee31-2931-46e5-86df-c4965c457642 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.817894 Oct 17 17:48:52.018579 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:48:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:48:52.030626 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-bc9c9ad4-a026-40ef-9219-cadf6a36a079 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:52.163720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-bc9c9ad4-a026-40ef-9219-cadf6a36a079 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136451 Oct 17 17:48:52.164368 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 17 17:48:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:48:54.795719 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-668dee31-2931-46e5-86df-c4965c457642 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:48:54.796779 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-668dee31-2931-46e5-86df-c4965c457642 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 17 17:48:54.798391 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:48:55.274696 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-30228dbc-46b2-4431-b70e-b774353d2534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "disk": 10}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:55.358004 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-30228dbc-46b2-4431-b70e-b774353d2534 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553101 Oct 17 17:48:55.358566 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:48:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:48:55.370732 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-91045616-c7b8-4524-9c64-4d475bf4256a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:55.466050 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-91045616-c7b8-4524-9c64-4d475bf4256a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099077 Oct 17 17:48:55.467268 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 17 17:48:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:48:58.141690 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-30228dbc-46b2-4431-b70e-b774353d2534 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:48:58.143264 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-30228dbc-46b2-4431-b70e-b774353d2534 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Oct 17 17:48:58.143832 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:48:58.579826 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-167fd047-9c9a-4d87-840a-ec23baa8fab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:58.656185 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-167fd047-9c9a-4d87-840a-ec23baa8fab5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505379 Oct 17 17:48:58.657451 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:48:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:48:58.670412 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-bc00cf97-0228-4ec9-8272-bb149149e730 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:48:58.758189 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-bc00cf97-0228-4ec9-8272-bb149149e730 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091385 Oct 17 17:48:58.758973 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 17 17:48:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:49:01.450759 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-167fd047-9c9a-4d87-840a-ec23baa8fab5 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:01.452073 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-167fd047-9c9a-4d87-840a-ec23baa8fab5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Oct 17 17:49:01.452658 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:01.915201 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-2802e109-2a45-4a2a-b201-90e75077364d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:01.988249 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-2802e109-2a45-4a2a-b201-90e75077364d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528541 Oct 17 17:49:01.989030 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:49:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:02.002923 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-e191fa09-0b27-4c9d-962b-5d09646491ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:02.079018 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-e191fa09-0b27-4c9d-962b-5d09646491ff admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081208 Oct 17 17:49:02.079812 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 17 17:49:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:49:05.266642 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-2802e109-2a45-4a2a-b201-90e75077364d admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:05.267669 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-2802e109-2a45-4a2a-b201-90e75077364d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Oct 17 17:49:05.268081 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:05.698063 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-c4ee852c-8816-4bda-a14f-659db529440c admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:05.724881 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-c4ee852c-8816-4bda-a14f-659db529440c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.450456 Oct 17 17:49:05.725462 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 17 17:49:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:08.353870 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-2802e109-2a45-4a2a-b201-90e75077364d admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:08.354897 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-2802e109-2a45-4a2a-b201-90e75077364d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 17 17:49:08.355306 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:08.761258 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-dd1643de-cb3c-4b55-8553-f575a831211c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:08.828461 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-dd1643de-cb3c-4b55-8553-f575a831211c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.466663 Oct 17 17:49:08.830992 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:49:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:08.842680 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-07f7fba3-a97f-4811-87a9-151c4653d5c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:08.996035 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-07f7fba3-a97f-4811-87a9-151c4653d5c5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157174 Oct 17 17:49:09.000441 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 17 17:49:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:49:11.650490 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-dd1643de-cb3c-4b55-8553-f575a831211c admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:11.651401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-dd1643de-cb3c-4b55-8553-f575a831211c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 17 17:49:11.651914 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:12.016537 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-b9650663-39a3-4b18-b268-45da04b4c0fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "2"}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:12.199817 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-b9650663-39a3-4b18-b268-45da04b4c0fe admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.541314 Oct 17 17:49:12.202440 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:49:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:12.214084 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-edb3b615-1e40-4c98-9bfd-7d1fbcdb8281 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:12.306188 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-edb3b615-1e40-4c98-9bfd-7d1fbcdb8281 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096289 Oct 17 17:49:12.307026 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 17 17:49:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:49:15.102835 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-b9650663-39a3-4b18-b268-45da04b4c0fe admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:15.103765 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-b9650663-39a3-4b18-b268-45da04b4c0fe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 17 17:49:15.104164 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:49:15.619352 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-b9d9f04c-62de-4d0b-be01-d09bc5554ede admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "ram": 4096}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:15.701099 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-b9d9f04c-62de-4d0b-be01-d09bc5554ede admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.582289 Oct 17 17:49:15.701682 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:49:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:15.718202 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-e9c73655-c8ab-43b7-a248-622bff0764e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:15.723491 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:15.819821 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-e9c73655-c8ab-43b7-a248-622bff0764e6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108097 Oct 17 17:49:15.820408 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 17 17:49:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:49:18.488516 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-b9d9f04c-62de-4d0b-be01-d09bc5554ede admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:18.489481 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-b9d9f04c-62de-4d0b-be01-d09bc5554ede admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 17 17:49:18.490151 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:19.108224 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-ad2bbc87-4cc2-4869-ba52-04e6e5bd7da5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:19.467731 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-ad2bbc87-4cc2-4869-ba52-04e6e5bd7da5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.970245 Oct 17 17:49:19.470797 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:49:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:19.480951 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-1bddab1e-5ac6-43a7-ba94-948cc4811606 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:19.495884 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:19.586421 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-1bddab1e-5ac6-43a7-ba94-948cc4811606 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109023 Oct 17 17:49:19.588859 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 17 17:49:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:49:22.253620 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-ad2bbc87-4cc2-4869-ba52-04e6e5bd7da5 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:22.254641 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-ad2bbc87-4cc2-4869-ba52-04e6e5bd7da5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 17 17:49:22.255043 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:22.718682 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-276e6dfd-bbe4-4c46-96bb-1fd37b4393c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:22.801782 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-276e6dfd-bbe4-4c46-96bb-1fd37b4393c8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.540260 Oct 17 17:49:22.802679 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 17 17:49:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:22.816656 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-e7b9a4a1-4393-4638-966b-a8cd00ac9a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:22.890662 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-e7b9a4a1-4393-4638-966b-a8cd00ac9a27 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079693 Oct 17 17:49:22.891252 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 17 17:49:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:49:40.054636 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-276e6dfd-bbe4-4c46-96bb-1fd37b4393c8 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:40.055633 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-276e6dfd-bbe4-4c46-96bb-1fd37b4393c8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 17 17:49:40.056042 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:49:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:40.066602 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:40.477096 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-68bf51dd-e4e0-4082-bef6-952b34286674 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:40.495805 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-68bf51dd-e4e0-4082-bef6-952b34286674 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.433545 Oct 17 17:49:40.496252 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 17 17:49:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:41.864524 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-276e6dfd-bbe4-4c46-96bb-1fd37b4393c8 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:41.865575 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-276e6dfd-bbe4-4c46-96bb-1fd37b4393c8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 17 17:49:41.865979 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:42.413854 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-15a65d23-5a16-4271-aae2-03e5a5329b39 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:42.419439 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.wsgi [None req-15a65d23-5a16-4271-aae2-03e5a5329b39 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-15a65d23-5a16-4271-aae2-03e5a5329b39 admin admin] Request method failure captured: Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Accept: application/json Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Accept-Encoding: gzip, deflate Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Connection: keep-alive Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Content-Length: 0 Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Host: 10.222.0.58 Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Openstack-Api-Version: compute 2.92 Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Openstack-System-Scope: None Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: User-Agent: python-novaclient Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Auth-Token: gAAAAABjTZW1cjUVGXx3HQBZWuyzRZwFl82_Fv7IbmvoH_L56qpmp2GIpF6vUcyFi8lNLZoO6wP5gK4PIwRc-vdDZ7Rx0tivWGxiLVGQXQrKFLee979rc9E3dI6-OL3i-yABgsTLYzDyNdrxQT10MQ2mo64dcGgGdPd7Ujvyw4LLt1NM36ZEOjo Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Domain-Id: None Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Domain-Name: None Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Identity-Status: Confirmed Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Is-Admin-Project: True Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Domain-Id: default Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Domain-Name: Default Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Name: admin Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Role: reader,admin,member Oct 17 17:49:42.422720 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Roles: reader,admin,member Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8149c9f0281497aa4f5b410409e222f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}] Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant: admin Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant-Name: admin Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User: admin Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Domain-Id: default Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Domain-Name: Default Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Id: 4f2d7ef883b142089847f9a9d33176cd Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Name: admin Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: method: > Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: exception: Flavor 42 could not be found. Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: action_args: {'id': '42'} Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:49:42.425128 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:42.426346 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.427807 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-15a65d23-5a16-4271-aae2-03e5a5329b39 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:49:42.429065 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-15a65d23-5a16-4271-aae2-03e5a5329b39 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.401751 Oct 17 17:49:42.429065 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 17 17:49:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:42.435246 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-71597a98-b423-47c0-b077-035cde9ec5c9 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:42.439334 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:49:42.459183 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-71597a98-b423-47c0-b077-035cde9ec5c9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027689 Oct 17 17:49:42.459771 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 17 17:49:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:42.470669 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-4d69ec25-003e-45fe-b1e1-f622cdd1b2e3 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:42.494642 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-4d69ec25-003e-45fe-b1e1-f622cdd1b2e3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028383 Oct 17 17:49:42.495204 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 17 17:49:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:42.505182 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-98d171c0-3af9-4fb7-bf6c-0086f96c1ff7 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:42.510974 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.wsgi [None req-98d171c0-3af9-4fb7-bf6c-0086f96c1ff7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-98d171c0-3af9-4fb7-bf6c-0086f96c1ff7 admin admin] Request method failure captured: Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Accept: application/json Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Accept-Encoding: gzip, deflate Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Connection: keep-alive Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Content-Length: 0 Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Host: 10.222.0.58 Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Openstack-Api-Version: compute 2.92 Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Openstack-System-Scope: None Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: User-Agent: python-novaclient Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Auth-Token: gAAAAABjTZW1cjUVGXx3HQBZWuyzRZwFl82_Fv7IbmvoH_L56qpmp2GIpF6vUcyFi8lNLZoO6wP5gK4PIwRc-vdDZ7Rx0tivWGxiLVGQXQrKFLee979rc9E3dI6-OL3i-yABgsTLYzDyNdrxQT10MQ2mo64dcGgGdPd7Ujvyw4LLt1NM36ZEOjo Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Domain-Id: None Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Domain-Name: None Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Identity-Status: Confirmed Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Is-Admin-Project: True Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Domain-Id: default Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Domain-Name: Default Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Name: admin Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Role: reader,admin,member Oct 17 17:49:42.514427 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Roles: reader,admin,member Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8149c9f0281497aa4f5b410409e222f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}] Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant: admin Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant-Name: admin Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User: admin Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Domain-Id: default Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Domain-Name: Default Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Id: 4f2d7ef883b142089847f9a9d33176cd Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Name: admin Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: method: > Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: exception: Flavor 42 could not be found. Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: action_args: {'id': '42'} Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:49:42.523321 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:42.524299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:42.525436 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-98d171c0-3af9-4fb7-bf6c-0086f96c1ff7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:49:42.526426 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-98d171c0-3af9-4fb7-bf6c-0086f96c1ff7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014355 Oct 17 17:49:42.526426 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 17 17:49:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:43.770802 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-4d69ec25-003e-45fe-b1e1-f622cdd1b2e3 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:43.771801 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-4d69ec25-003e-45fe-b1e1-f622cdd1b2e3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 17 17:49:43.772198 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:44.325006 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-7eb924f9-0665-4142-b7d5-847e97a31627 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:44.330068 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.wsgi [None req-7eb924f9-0665-4142-b7d5-847e97a31627 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-7eb924f9-0665-4142-b7d5-847e97a31627 admin admin] Request method failure captured: Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Accept: application/json Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Accept-Encoding: gzip, deflate Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Connection: keep-alive Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Content-Length: 0 Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Host: 10.222.0.58 Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Openstack-Api-Version: compute 2.92 Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Openstack-System-Scope: None Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: User-Agent: python-novaclient Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Auth-Token: gAAAAABjTZW3kE3093HRbQH24sTGi8II2uJSsjVS70VdMp74SjH_UVlI6NVDT1_2ipjJB7NZf1LLw3BGWUJPpxeDYDWTqPuxSeLPqfDQWnfOVx5CtEXLexXeIak7Nnx5s1k_qenUBosr9qpIPrOva9nGSHuA6DVZsUoZTySjWQU5NA-y4D4oNmY Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Domain-Id: None Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Domain-Name: None Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Identity-Status: Confirmed Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Is-Admin-Project: True Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Domain-Id: default Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Domain-Name: Default Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Name: admin Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Role: reader,admin,member Oct 17 17:49:44.331883 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Roles: reader,admin,member Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8149c9f0281497aa4f5b410409e222f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}] Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant: admin Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant-Name: admin Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User: admin Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Domain-Id: default Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Domain-Name: Default Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Id: 4f2d7ef883b142089847f9a9d33176cd Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Name: admin Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: method: > Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: exception: Flavor 84 could not be found. Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: action_args: {'id': '84'} Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:49:44.333476 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:44.334401 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.335807 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-7eb924f9-0665-4142-b7d5-847e97a31627 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:49:44.337019 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-7eb924f9-0665-4142-b7d5-847e97a31627 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.416567 Oct 17 17:49:44.337019 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 17 17:49:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:44.343367 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-a3cc1973-3c51-4f10-add3-3b482073afd4 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:44.358272 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-a3cc1973-3c51-4f10-add3-3b482073afd4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018495 Oct 17 17:49:44.358827 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 17 17:49:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:44.369733 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-14674e01-1eb9-416d-9818-6cd673d96996 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:44.386305 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-14674e01-1eb9-416d-9818-6cd673d96996 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020130 Oct 17 17:49:44.386850 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 17 17:49:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:44.397140 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-90d62bbe-807c-4d6e-8e3c-9c3e383b9d3f admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:44.402230 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.wsgi [None req-90d62bbe-807c-4d6e-8e3c-9c3e383b9d3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-90d62bbe-807c-4d6e-8e3c-9c3e383b9d3f admin admin] Request method failure captured: Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Accept: application/json Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Accept-Encoding: gzip, deflate Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Connection: keep-alive Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Content-Length: 0 Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Host: 10.222.0.58 Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Openstack-Api-Version: compute 2.92 Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Openstack-System-Scope: None Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: User-Agent: python-novaclient Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Auth-Token: gAAAAABjTZW3kE3093HRbQH24sTGi8II2uJSsjVS70VdMp74SjH_UVlI6NVDT1_2ipjJB7NZf1LLw3BGWUJPpxeDYDWTqPuxSeLPqfDQWnfOVx5CtEXLexXeIak7Nnx5s1k_qenUBosr9qpIPrOva9nGSHuA6DVZsUoZTySjWQU5NA-y4D4oNmY Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Domain-Id: None Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Domain-Name: None Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Identity-Status: Confirmed Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Is-Admin-Project: True Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Domain-Id: default Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Domain-Name: Default Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Name: admin Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Role: reader,admin,member Oct 17 17:49:44.403734 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Roles: reader,admin,member Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8149c9f0281497aa4f5b410409e222f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}] Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant: admin Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant-Name: admin Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User: admin Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Domain-Id: default Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Domain-Name: Default Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Id: 4f2d7ef883b142089847f9a9d33176cd Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Name: admin Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: method: > Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: exception: Flavor 84 could not be found. Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: action_args: {'id': '84'} Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:49:44.405396 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:44.406210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:44.407702 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-90d62bbe-807c-4d6e-8e3c-9c3e383b9d3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:49:44.409013 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-90d62bbe-807c-4d6e-8e3c-9c3e383b9d3f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012372 Oct 17 17:49:44.409013 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 17 17:49:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:45.647073 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-14674e01-1eb9-416d-9818-6cd673d96996 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:45.648105 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-14674e01-1eb9-416d-9818-6cd673d96996 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 17 17:49:45.648496 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:46.179210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-efcbb646-9714-4b96-aaf5-df447fd4feed admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:46.185154 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.wsgi [None req-efcbb646-9714-4b96-aaf5-df447fd4feed admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-efcbb646-9714-4b96-aaf5-df447fd4feed admin admin] Request method failure captured: Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Accept: application/json Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Accept-Encoding: gzip, deflate Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Connection: keep-alive Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Content-Length: 0 Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Host: 10.222.0.58 Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Openstack-Api-Version: compute 2.92 Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Openstack-System-Scope: None Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: User-Agent: python-novaclient Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Auth-Token: gAAAAABjTZW5tY7fZz6tFMgp9plOfwH16pPnZCPk2KOibclyCCsxhAoxcG03nnzDQyqPQXoTGkwT6KPfDtqIwxw0bHKwbWWq3y2vPoKyjxg1SmQr1DXiKMe1zcpq7t-0_0I6YWWYYIL7IdpxaeFMp9BVB1TmIeUq4ss_U25ZRe_1i8sStlX9y3g Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Domain-Id: None Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Domain-Name: None Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Identity-Status: Confirmed Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Is-Admin-Project: True Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Domain-Id: default Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Domain-Name: Default Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Project-Name: admin Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Role: reader,admin,member Oct 17 17:49:46.186652 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Roles: reader,admin,member Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8149c9f0281497aa4f5b410409e222f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}] Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant: admin Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-Tenant-Name: admin Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User: admin Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Domain-Id: default Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Domain-Name: Default Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Id: 4f2d7ef883b142089847f9a9d33176cd Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: X-User-Name: admin Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: method: > Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: exception: Flavor 451 could not be found. Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: action_args: {'id': '451'} Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:49:46.188200 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:46.189210 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.190849 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-efcbb646-9714-4b96-aaf5-df447fd4feed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:49:46.191884 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-efcbb646-9714-4b96-aaf5-df447fd4feed admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400720 Oct 17 17:49:46.191884 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 17 17:49:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:46.198603 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-44c91e7b-46fe-425c-af3a-262b4764ce62 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:46.214478 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-44c91e7b-46fe-425c-af3a-262b4764ce62 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019493 Oct 17 17:49:46.215038 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 17 17:49:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:46.224821 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:46.239758 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018651 Oct 17 17:49:46.240299 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 17 17:49:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:49:46.250063 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-3d16e5a7-754b-49f3-ab22-9b1bbb4c2d52 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:46.255949 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.wsgi [None req-3d16e5a7-754b-49f3-ab22-9b1bbb4c2d52 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-3d16e5a7-754b-49f3-ab22-9b1bbb4c2d52 admin admin] Request method failure captured: Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Accept: application/json Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Accept-Encoding: gzip, deflate Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Connection: keep-alive Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Content-Length: 0 Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Host: 10.222.0.58 Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Openstack-Api-Version: compute 2.92 Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Openstack-System-Scope: None Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: User-Agent: python-novaclient Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Auth-Token: gAAAAABjTZW5tY7fZz6tFMgp9plOfwH16pPnZCPk2KOibclyCCsxhAoxcG03nnzDQyqPQXoTGkwT6KPfDtqIwxw0bHKwbWWq3y2vPoKyjxg1SmQr1DXiKMe1zcpq7t-0_0I6YWWYYIL7IdpxaeFMp9BVB1TmIeUq4ss_U25ZRe_1i8sStlX9y3g Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Domain-Id: None Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Domain-Name: None Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Identity-Status: Confirmed Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Is-Admin-Project: True Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Domain-Id: default Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Domain-Name: Default Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Project-Name: admin Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Role: reader,admin,member Oct 17 17:49:46.257577 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Roles: reader,admin,member Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8149c9f0281497aa4f5b410409e222f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8149c9f0281497aa4f5b410409e222f"}]}] Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant: admin Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant-Id: d8149c9f0281497aa4f5b410409e222f Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-Tenant-Name: admin Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User: admin Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Domain-Id: default Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Domain-Name: Default Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Id: 4f2d7ef883b142089847f9a9d33176cd Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: X-User-Name: admin Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: method: > Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: exception: Flavor 451 could not be found. Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: action_args: {'id': '451'} Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:49:46.259127 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:46.264817 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: ERROR nova.api.openstack.wsgi Oct 17 17:49:46.265882 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-3d16e5a7-754b-49f3-ab22-9b1bbb4c2d52 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111035) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:49:46.266987 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-3d16e5a7-754b-49f3-ab22-9b1bbb4c2d52 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012510 Oct 17 17:49:46.266987 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 17 17:49:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 17:49:47.505285 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:47.506407 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Oct 17 17:49:47.506805 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:48.054021 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-62463d5a-ae40-44ac-a7bf-73adfe8fc79b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:48.138107 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-62463d5a-ae40-44ac-a7bf-73adfe8fc79b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.487796 Oct 17 17:49:48.138672 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 17 17:49:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:49.383186 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:49.384312 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 17 17:49:49.384585 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:49.935833 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-6fafd6de-e35f-4a68-a0d6-6e5d1232cb46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:50.012803 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-6fafd6de-e35f-4a68-a0d6-6e5d1232cb46 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.488835 Oct 17 17:49:50.013360 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 17 17:49:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 17:49:51.267653 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:51.268858 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 17 17:49:51.269377 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:51.811299 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-7581e8a8-e168-4dc6-8d60-d612f281f496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:51.949390 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-7581e8a8-e168-4dc6-8d60-d612f281f496 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.542076 Oct 17 17:49:51.949877 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 17 17:49:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:53.192357 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:53.193414 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 17 17:49:53.193813 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:53.732198 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-3f201bf9-1407-4d18-97a3-fad3ad2a7448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:49:53.817950 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-3f201bf9-1407-4d18-97a3-fad3ad2a7448 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.482785 Oct 17 17:49:53.818422 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 17 17:49:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:49:55.097599 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:55.098620 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Oct 17 17:49:55.099027 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:49:55.644947 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-c40ccdbd-0eda-4662-93b5-78ac0c9781b0 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:49:55.666915 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-c40ccdbd-0eda-4662-93b5-78ac0c9781b0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.428221 Oct 17 17:49:55.667473 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Mon Oct 17 17:49:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:50:54.293548 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:50:54.294561 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-243aedb9-8ba0-4f1b-b571-272c2d5829e6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 17 17:50:54.295499 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 17 17:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:50:54.306492 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:54.700106 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-2e608415-10b3-4c78-8086-46ef25eac61a admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:50:54.722876 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-2e608415-10b3-4c78-8086-46ef25eac61a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420096 Oct 17 17:50:54.723435 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 17 17:50:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:50:54.744517 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_api:SELECT=14 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:50:54.748337 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-25e70441-cf1f-4219-a934-d6381c52fdc2 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:50:54.755877 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-25e70441-cf1f-4219-a934-d6381c52fdc2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012847 Oct 17 17:50:54.756434 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Mon Oct 17 17:50:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:50:54.770345 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-68d5d336-57ed-4408-b8a1-d55a5cc63cac admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:50:54.778103 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-68d5d336-57ed-4408-b8a1-d55a5cc63cac admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012918 Oct 17 17:50:54.778656 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Mon Oct 17 17:50:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:50:54.791428 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:50:54.799506 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011716 Oct 17 17:50:54.800118 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Mon Oct 17 17:50:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:50:54.812075 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-e9943656-25d0-4eb8-aa27-aad6a70b1a75 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:50:54.820178 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-e9943656-25d0-4eb8-aa27-aad6a70b1a75 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011743 Oct 17 17:50:54.820782 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Mon Oct 17 17:50:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:54:08.068119 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:08.069186 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 17 17:54:08.069575 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:54:08.209360 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_api:SELECT=6 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:08.369975 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:08.374866 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:08.375340 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:08.375768 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:08.376483 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:08.376963 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:08.377378 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:08.409895 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-d616ae2a-ab07-4266-ba4f-d30b9936693d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201661 Oct 17 17:54:08.410446 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 17 17:54:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:54:09.491729 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:09.492842 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 17 17:54:09.493177 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:54:09.686995 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:09.690559 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:09.691030 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:09.691459 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:09.692207 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:09.692676 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:09.693094 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:09.712463 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-3f4680e8-addb-4522-b6ef-e0414b582026 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075791 Oct 17 17:54:09.713046 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 17 17:54:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:54:21.319538 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:21.321223 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Oct 17 17:54:21.321627 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:54:21.471049 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_cell0:SELECT=4 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:21.471865 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_cell1:SELECT=4 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:21.472482 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG dbcounter [-] [111035] Writing DB stats nova_api:SELECT=8 {{(pid=111035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:54:21.527117 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:21.531204 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:21.531814 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:21.532239 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:21.532976 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:21.533413 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:21.533865 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:21.561691 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-b7cd2c6c-888f-40a5-ba67-d22b3c893301 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.095462 Oct 17 17:54:21.562250 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 17 17:54:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:54:22.732222 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG nova.api.openstack.wsgi [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] Calling method '>' {{(pid=111034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:22.733781 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: INFO nova.api.openstack.requestlog [None req-889af11b-7f3c-4687-a0fb-16b09a0b6001 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 17 17:54:22.734278 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: [pid: 111034|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 17 17:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:54:22.926635 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG nova.api.openstack.wsgi [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Calling method '>' {{(pid=111035) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:54:22.930160 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:22.930625 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:22.931042 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:22.931741 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:54:22.932178 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:54:22.932588 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: DEBUG oslo_concurrency.lockutils [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111035) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:54:22.954418 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: INFO nova.api.openstack.requestlog [None req-2e1f5178-ee7d-4dec-82e3-1fd54c68d165 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.081888 Oct 17 17:54:22.954892 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: [pid: 111035|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 17 17:54:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:55:19.622918 dv-cinder-861609-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 17:55:19.623507 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: Mon Oct 17 17:55:19 2022 - graceful shutdown triggered... Oct 17 17:55:19.624012 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: Gracefully killing worker 1 (pid: 111034)... Oct 17 17:55:19.624448 dv-cinder-861609-1-iscsi devstack@n-api.service[111035]: Gracefully killing worker 2 (pid: 111035)... Oct 17 17:55:19.750505 dv-cinder-861609-1-iscsi devstack@n-api.service[111034]: DEBUG dbcounter [-] [111034] Writing DB stats nova_api:SELECT=4 {{(pid=111034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:55:20.624102 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: worker 1 buried after 1 seconds Oct 17 17:55:20.624102 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: worker 2 buried after 1 seconds Oct 17 17:55:20.624102 dv-cinder-861609-1-iscsi devstack@n-api.service[111033]: goodbye to uWSGI. Oct 17 17:55:20.625698 dv-cinder-861609-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 17 17:55:20.626248 dv-cinder-861609-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 17:55:20.628981 dv-cinder-861609-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 17:55:20.642939 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 17:55:20 2022] *** Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: nodename: dv-cinder-861609-1-iscsi Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: machine: x86_64 Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: clock source: unix Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: pcre jit disabled Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: detected number of CPU cores: 4 Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: current working directory: / Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: detected binary path: /usr/bin/uwsgi-core Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: your processes number limit is 47680 Oct 17 17:55:20.646059 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: your memory page size is 4096 bytes Oct 17 17:55:20.647037 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: detected max file descriptor number: 2048 Oct 17 17:55:20.647037 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: lock engine: pthread robust mutexes Oct 17 17:55:20.647037 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: thunder lock: enabled Oct 17 17:55:20.647037 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 17:55:20.647037 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 17:55:20.688366 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: Python main interpreter initialized at 0x5622bab5d9c0 Oct 17 17:55:20.688366 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: python threads support enabled Oct 17 17:55:20.688366 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: your server socket listen backlog is limited to 100 connections Oct 17 17:55:20.688366 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: your mercy for graceful operations on workers is 90 seconds Oct 17 17:55:20.688830 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 17:55:20.688830 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: *** Operational MODE: preforking *** Oct 17 17:55:20.688996 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: *** uWSGI is running in multiple interpreter mode *** Oct 17 17:55:20.688996 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: spawned uWSGI master process (pid: 126508) Oct 17 17:55:20.689153 dv-cinder-861609-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 17:55:20.690568 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: spawned uWSGI worker 1 (pid: 126519, cores: 1) Oct 17 17:55:20.690943 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: spawned uWSGI worker 2 (pid: 126522, cores: 1) Oct 17 17:55:20.690943 dv-cinder-861609-1-iscsi devstack@n-api.service[126508]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 17:55:21.384324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 17:55:21.438662 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 17:55:22.554708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:55:22.554708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: from cryptography.utils import int_from_bytes Oct 17 17:55:22.555347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:55:22.555347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: from cryptography.utils import int_from_bytes Oct 17 17:55:22.611874 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:55:22.611874 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: from cryptography.utils import int_from_bytes Oct 17 17:55:22.612575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 17:55:22.612575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: from cryptography.utils import int_from_bytes Oct 17 17:55:25.026939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 17:55:25.027663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 17:55:25.027766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 17:55:25.028083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 17:55:25.028337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 17:55:25.028757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.029103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.029406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.029729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.030084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.030370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.030692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.030915 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 17:55:25.031340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.031424 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 17:55:25.031506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.031601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.031741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 17:55:25.031962 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.032076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 17:55:25.032181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861609-1-iscsi {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.032358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 17:55:25.032538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.032730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.032835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033133 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033357 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033673 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.033989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.034154 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.034303 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.034472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.034625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.034952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.035082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.039738 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.039851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.039937 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861609-1-iscsi {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040483 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040750 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.040898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.041468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.041665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.041857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.042061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.042264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.042449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861609-1-iscsi {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.042643 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.042643 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.043003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.043205 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.043387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.043590 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.043782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.043975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.044194 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.044392 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.044392 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.044723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.044891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.044891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.045248 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.045387 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.045521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.045664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.045664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861609-1-iscsi {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.045958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.046102 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.046241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.046410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.046410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.046923 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.047068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.047208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.047382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.047530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.047665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.047665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.048008 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.048148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.048284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.048926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.048926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.049257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.049399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.049399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.049660 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.049798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.049798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050113 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050945 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.050945 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.051204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.051204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.051465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.051599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.051599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.052578 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.052839 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.052981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053872 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.053872 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054127 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.054899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055159 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055556 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.055977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.056226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.056365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.056365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.056650 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.056832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.057118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.057295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.057295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.057569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.057702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.057909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.058035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.058035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.058286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.058428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.058428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.058428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.059448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.059578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.059717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.059862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.059997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.060125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.060125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.060569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.060747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.060747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.061968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062572 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.062994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.063186 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.063314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.063495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.063624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.063805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.063937 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.064116 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.064250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.064427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.064555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.064762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.074579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.074778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.074929 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.075084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.075235 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.075384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.075553 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.075708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.075857 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076009 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076662 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076831 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.076985 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.077135 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.077284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.077481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.077481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.077768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.077918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.078066 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.078214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.078356 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.078503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.078645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.078800 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.079471 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.079638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.079789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.079939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.080100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.080300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.080452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.080621 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.080975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.081124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.081276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.081425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.081568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.081710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.081852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.082096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.082257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.082419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.082561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.082702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.082845 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.083088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.083342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.083553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.083704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.083863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.084007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.084148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.084298 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.084448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.084761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.084946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.085093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.085242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.085394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.085579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.085726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.085876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086444 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086653 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086808 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.086952 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.087093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.087246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.087388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.087616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.087768 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.087917 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.088067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.088218 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.088366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.088521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.088697 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.088842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.088997 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.089709 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.089869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.090027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.090171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.090332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.090332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.090618 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.090770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.090920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.090920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.091443 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.091588 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.091730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.091881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.092030 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.092183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.092327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.092468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.092646 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.092812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.092955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.093103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.093264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 17:55:25.093414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.093563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.093715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.093858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094007 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094299 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.094941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095261 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095698 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.095983 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.096125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.096274 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.096431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.096582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.096761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.096910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097553 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097850 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.097993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.098279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.098422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.099123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.099302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.100536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.100779 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.100926 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.101083 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.101247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.101635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.101784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.101938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.102082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.102232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.102377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.102519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.102707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.102863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103017 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103459 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.103766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.104044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.104193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.104350 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.104505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.104676 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.104871 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.105028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.105179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.105420 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.105578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.105723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.105866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106587 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.106887 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107188 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107493 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107783 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.107937 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.108090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.108232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.108373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.108514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.108700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.108858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.109025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.109170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.109320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.109472 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.109623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.109865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.110024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.113326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.113326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.113652 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.113804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.113951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.114121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.114428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.115700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.115861 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116160 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116314 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116628 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.116921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.120890 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121825 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.121968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.122109 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.122260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.122403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.122552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.122706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.123521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.123686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.123841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.123992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.124149 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.124306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.124449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.124609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.124771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.124920 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.125195 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.125346 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.125504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.125647 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.125810 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.125953 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.126108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.126262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.126423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.126691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.126855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127008 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127311 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127596 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.127900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.128052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.128203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.128346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.128494 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.128703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.128868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.129012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.129164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.129306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.129456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.129610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.129765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.130062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.130341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.130558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.130558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.130841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.130994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.131138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.131279 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.131428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.131579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.131736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.131886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132190 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132482 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132810 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.132978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.133844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134313 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134455 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134759 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.134916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135458 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.135991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.136944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137063 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137637 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.137993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.138111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.138808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.138942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139408 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139524 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139879 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.139990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140833 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.140987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141146 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141436 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141671 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141826 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.141981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142262 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142331 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142565 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142637 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142791 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.142949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.143020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.143095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.143173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.143279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.144582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.145261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.145391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.145894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.146425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.146600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.146725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.146837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.146954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.146954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147299 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147410 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147760 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.147871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148782 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.148904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149366 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149483 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.149890 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.150954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151072 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151182 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151372 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151593 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.151821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.152977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.153087 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.153197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.153315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.154922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.155957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156308 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.156915 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.157931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158040 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.158880 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159015 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159595 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159705 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159814 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.159814 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160833 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.160975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.161643 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.162857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.162993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.163117 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.163245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.163365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.163477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.163587 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164873 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.164985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165328 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.165931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166160 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166642 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166753 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.166982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167208 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167326 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167560 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167678 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.167911 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168620 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.168996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169116 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169572 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169683 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169793 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.169910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170036 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170493 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.170929 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.171098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.171236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.171373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.171511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.171907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172628 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172760 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.172906 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.173048 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.173177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.173315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.173446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.173573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.173730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.174968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175241 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.175921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.176042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.176165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.176276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.176385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.176495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.176631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.177538 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178767 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.178998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179115 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179651 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179763 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.179881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180000 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180469 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.180912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.181984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182243 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182607 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182718 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.182834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.183517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.183649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.183769 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.183887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.184437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.184578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.184729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.184853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.185271 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.185418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.185559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.185703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.185835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.185965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186502 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.186901 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187425 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187776 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.187896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188021 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188154 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188275 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188647 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.188974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.189976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190524 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190634 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.190997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.191302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.191433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.191545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.191670 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.191782 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.191900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.192013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.192138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.192251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.192979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.197000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.197765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.197914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198570 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198812 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.198921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199524 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.199868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200300 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200531 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.200987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.201138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.201425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.201425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.201696 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.201827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.201957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.202908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203318 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203587 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203587 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203836 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.203966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.204230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.204360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.204490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.204635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.204778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.204908 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.205850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.206022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.206153 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.206282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.206440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.206665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.206888 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207326 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207465 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.207853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.208027 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.208736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.208904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.209041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.209231 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.209374 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.209579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.209724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.209864 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.210954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211127 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211608 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211779 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.211932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212554 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212554 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212554 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.212941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213340 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213769 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.213953 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214279 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214364 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.214902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215117 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.215885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216048 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216133 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216318 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216318 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.216942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217671 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.217959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.218983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.219994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220493 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220493 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220493 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220793 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220887 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.220887 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221399 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221399 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221711 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221711 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221711 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.221962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222465 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.222876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223036 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223383 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223383 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.223535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.224163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.224163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.224163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.224996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.224996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.229997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.229997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.230928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.231954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232498 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232632 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232722 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232811 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.232910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233096 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233185 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233695 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233895 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.233991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234220 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234371 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234718 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.234928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235108 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235291 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235608 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.235767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.236973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.237192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.237430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.237568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.237792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.237898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.238061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.238167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.238413 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.238524 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.238707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.238811 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.239048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.239150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.239503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.239758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.239861 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.240090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.240262 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.240417 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.240637 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.240801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.240955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.241111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.241322 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.241534 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.241765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.241858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.241940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.242157 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.242301 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.242473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.242579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.242853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.242971 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.243103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.243207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.243418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.243513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.243735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.243838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.244054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.244162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.244370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.244471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.244710 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.244810 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.245031 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.245140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.245349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.245451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.245666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.245775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.246063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.246178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.246450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.246591 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.246775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.246910 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.247091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.247248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.247438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.247613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.247758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.247908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.248230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.248388 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.248553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.248719 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.248913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.249065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.249245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.249382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.249517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.249697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.249842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250477 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.250960 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.251095 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.251262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.251405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.251569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.251708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.251881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.252020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.252186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.252459 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.252634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.252831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.252990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.253126 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.253260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.253450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.253594 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.253730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.253873 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.254082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.254266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.254416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.254622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.254770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.254971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.255158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.255304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.255583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.255715 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.255931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.256076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.256304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.256449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.256668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.256824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.256974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.257110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.257243 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.257377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.257558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.257682 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.257870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.258185 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.258452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.258598 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.258772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.258912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.259083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.259221 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.259404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.259548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.259713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.259859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260646 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260789 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.260962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.261100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.261276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.261420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.261607 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.261755 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.261897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262471 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.262914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.263084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.263224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.263390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.263529 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.263702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.263848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.264998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.265139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.265290 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.265425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.265606 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.265747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.265896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.266043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.266250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.266387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.266600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.266747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.266919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.267065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.267258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.267461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.267599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.267804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.267931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.268129 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.268285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.268467 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.268627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.268827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.268976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.269119 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.269261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.269422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.269690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.269809 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.270034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.270140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.270345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.271059 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.271608 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.271713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.271812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.271902 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.271996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.272083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.272242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.272345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.272527 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.272720 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.272918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.273055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.273233 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.273380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.273551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.273698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.273870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274451 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274592 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.274870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.275077 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.275240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.275399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.275544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.275742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.275880 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.276060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.276207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.276371 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.276517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.276706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.276846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277330 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.277945 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278289 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278561 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.278996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.279179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.279316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.279487 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.279634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.279795 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.279930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.280104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.280239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.280410 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.280556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.280735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.280869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.281068 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.281214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.281368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.281525 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.281661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.281838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.282107 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.282339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.282486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.282724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.282887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.283053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.283219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.283407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.283564 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.283740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.283873 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.284068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.284216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.284378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.284526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.284720 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.284863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285030 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.285969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.286226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.286889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.287280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.287505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.287653 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.287842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.287981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.288148 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.288286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.288452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.288662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.288810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.288959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.289091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.289225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.289413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.289548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.289721 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.289900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290314 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290615 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.290910 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291518 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.291941 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.292103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.292254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.292397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.292539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.292725 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.292881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293444 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293774 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.293909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294197 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294340 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.294946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.295090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.295232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.295392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.295530 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.295694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.295841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.296028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.296166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.296362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.296501 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.296963 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.297114 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.297292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.297442 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.297604 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.297751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.297927 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.298105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.298239 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.298376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.298541 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.298677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.298857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299335 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299605 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299789 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.299936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.300104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.300240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.300415 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.300560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.300745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.300882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.301044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.301191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.301354 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.301500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.301664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.301871 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.302116 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.302284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.302509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.302735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.302874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.303880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.304056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.304195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.304381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.304528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.304725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.304877 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.305996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.306182 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.306336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.306473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.306613 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.306749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.306933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.307978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.308121 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.308245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.308415 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.308553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.308747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.308899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 17:55:25.309074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.309400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.309744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.310063 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.310408 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.310738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.311052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.311444 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.311756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 17:55:25.311998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 17:55:25.372905 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO dbcounter [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Registered counter for database nova_api Oct 17 17:55:25.395053 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.403306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writer thread running {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.462274 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.context [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),055a56ef-b612-4d83-a035-3bdaaf8bd0d1(cell1) {{(pid=126522) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 17:55:25.466287 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:55:25.466684 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO dbcounter [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Registered counter for database nova_api Oct 17 17:55:25.466840 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:55:25.468337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:55:25.469090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:55:25.469536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:55:25.471547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:55:25.473591 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO dbcounter [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Registered counter for database nova_cell0 Oct 17 17:55:25.477845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO dbcounter [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Registered counter for database nova_cell1 Oct 17 17:55:25.484857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.487526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_db.sqlalchemy.engines [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.488025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.492416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writer thread running {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.495489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writer thread running {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.554211 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.context [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),055a56ef-b612-4d83-a035-3bdaaf8bd0d1(cell1) {{(pid=126519) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 17:55:25.558349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:55:25.558759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:55:25.560339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:55:25.561094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:55:25.561537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:55:25.563502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:55:25.565513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO dbcounter [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Registered counter for database nova_cell0 Oct 17 17:55:25.569658 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO dbcounter [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Registered counter for database nova_cell1 Oct 17 17:55:25.577497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_db.sqlalchemy.engines [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.579794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_db.sqlalchemy.engines [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.586206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writer thread running {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.635854 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writer thread running {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.646097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO dbcounter [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Registered counter for database nova_cell0 Oct 17 17:55:25.653658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.658050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writer thread running {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.732328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writer thread running {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.742485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO dbcounter [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Registered counter for database nova_cell0 Oct 17 17:55:25.750830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_db.sqlalchemy.engines [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 17:55:25.756343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writer thread running {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 17:55:25.984962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: WARNING keystonemiddleware.auth_token [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:55:25.993255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: WARNING keystonemiddleware.auth_token [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:55:26.082645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: WARNING keystonemiddleware.auth_token [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:55:26.091200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: WARNING keystonemiddleware.auth_token [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:55:26.343971 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: WARNING keystonemiddleware.auth_token [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:55:26.350396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: WARNING keystonemiddleware.auth_token [None req-1fc49b06-d1cd-4069-a87b-392679ac363b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:55:26.355880 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5622bab5d9c0 pid: 126522 (default app) Oct 17 17:55:26.442467 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: WARNING keystonemiddleware.auth_token [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 17:55:26.448657 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: WARNING keystonemiddleware.auth_token [None req-15044230-9a44-4f43-99a8-3c1555dca06f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 17:55:26.453958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5622bab5d9c0 pid: 126519 (default app) Oct 17 17:56:03.373037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:03.373872 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:03.374650 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:03.375409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:04.237209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:04.238150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:04.239265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:04.240182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:05.076981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4c9a2cc1-6528-4347-a27f-ca885419f7a1 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Action: 'create', calling method: .version_select at 0x7f0197177550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2108632952"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:05.474816 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ca8de004-4450-44ef-8fa8-78d90c9bde3d tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Action: 'create', calling method: .version_select at 0x7f01971e05e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-545588036", "metadata": {"Type": "work"}}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:06.946263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4c9a2cc1-6528-4347-a27f-ca885419f7a1 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.582895 Oct 17 17:56:06.946927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Mon Oct 17 17:56:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3585 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 17:56:06.965484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-591c869a-6c21-4757-8e51-47612baac8a2 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f019704b430>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:07.239351 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-591c869a-6c21-4757-8e51-47612baac8a2 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 200 len: 345 microversion: 2.1 time: 0.278357 Oct 17 17:56:07.240176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 2/2] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:06 2022] GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:56:07.421426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ca8de004-4450-44ef-8fa8-78d90c9bde3d tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.188422 Oct 17 17:56:07.422791 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 17 17:56:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3192 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 17 17:56:07.444272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9f7f6294-085c-4345-b8eb-378051cca67d tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Calling method '.version_select at 0x7f019704baf0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:07.558360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9f7f6294-085c-4345-b8eb-378051cca67d tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c" status: 200 len: 352 microversion: 2.1 time: 0.123726 Oct 17 17:56:07.558950 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 3/4] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:07 2022] GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:08.255259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-717f126c-ef05-4551-a340-54a60aef91ad tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196ffb310>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:08.361821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-717f126c-ef05-4551-a340-54a60aef91ad tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 200 len: 346 microversion: 2.1 time: 0.112008 Oct 17 17:56:08.362382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 2/5] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:08 2022] GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:08.378478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-795b464b-410e-48d6-aea5-7e9c5d81065f tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Action: 'create', calling method: .version_select at 0x7f0196fe41f0>, body: {"snapshot": {"volume_id": "c89fcd29-68b3-48ae-a13b-0d28b5f78b9e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-469446512"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:08.579302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3e8d18a1-325a-464b-9ec3-0de760525de8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Calling method '.version_select at 0x7f0196ffba60>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:08.685657 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3e8d18a1-325a-464b-9ec3-0de760525de8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c" status: 200 len: 353 microversion: 2.1 time: 0.114193 Oct 17 17:56:08.686458 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:08 2022] GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:08.700289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f9bd431e-271d-455b-aae9-8f745b0aa279 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Calling method '.version_select at 0x7f0197016160>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:08.791344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f9bd431e-271d-455b-aae9-8f745b0aa279 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c" status: 200 len: 353 microversion: 2.1 time: 0.094400 Oct 17 17:56:08.792932 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:08 2022] GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:08.815307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9f3adc1c-d9c7-4394-b163-db10c7f0ed75 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Calling method '.version_select at 0x7f0196ffbd30>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:09.055289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9f3adc1c-d9c7-4394-b163-db10c7f0ed75 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c" status: 202 len: 0 microversion: 2.1 time: 0.244000 Oct 17 17:56:09.055974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 17:56:08 2022] DELETE /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 17:56:09.066599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-12421edb-7bc1-4b36-b7ea-9b12369f9e16 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Calling method '.version_select at 0x7f0196ffb5e0>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:09.184281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-12421edb-7bc1-4b36-b7ea-9b12369f9e16 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c" status: 200 len: 352 microversion: 2.1 time: 0.123246 Oct 17 17:56:09.191319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 6/9] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:09 2022] GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:09.443750 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-795b464b-410e-48d6-aea5-7e9c5d81065f tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.068160 Oct 17 17:56:09.446127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 4/10] 10.222.0.58 () {60 vars in 1162 bytes} [Mon Oct 17 17:56:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:09.459368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d1c66ded-06a1-489f-9a7d-f050dd407cf3 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0197016280>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:09.526053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d1c66ded-06a1-489f-9a7d-f050dd407cf3 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 200 len: 286 microversion: 2.1 time: 0.072042 Oct 17 17:56:09.527363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 7/11] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:09 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:09.541452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-51486591-377f-4380-8925-3e8ca2ad3ee8 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196fe4dc0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:09.652434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-51486591-377f-4380-8925-3e8ca2ad3ee8 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.117719 Oct 17 17:56:09.662141 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1140 bytes} [Mon Oct 17 17:56:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:09.673906 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-43bafef3-15c3-4242-b628-748c33429b2e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196ffb310>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:09.827407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-43bafef3-15c3-4242-b628-748c33429b2e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 200 len: 286 microversion: 2.1 time: 0.165608 Oct 17 17:56:09.828468 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:09 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:10.202685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a2324de-342c-41b0-9a27-6532632ea6d8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Calling method '.version_select at 0x7f019704b9d0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:10.264043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-5a2324de-342c-41b0-9a27-6532632ea6d8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] HTTP exception thrown: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a2324de-342c-41b0-9a27-6532632ea6d8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Request method failure captured: Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c HTTP/1.1 Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZc0n6gtEErS-qN9k1XvFGDvA8-Gcd3vfP28oyBAUtUTV9Gqg0sPpXEbcNH6Zut2BR21xXjfBvptFvmED0ETPw9ITNaerVS28GfiIcuCgLCVfETNGgYZmkY3tuEe-sAjIsuQtnadrRzcNGlyPgtgT3MzhRn2Qi6hKWMWx8ZuFTL3m5Y Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 3bbdca8cdfe54021b7eeb59660c232a8 Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesGetTestJSON-152150800 Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:56:10.280402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3bbdca8cdfe54021b7eeb59660c232a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3bbdca8cdfe54021b7eeb59660c232a8", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3bbdca8cdfe54021b7eeb59660c232a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3bbdca8cdfe54021b7eeb59660c232a8"}]}] Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesGetTestJSON-152150800 Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 3bbdca8cdfe54021b7eeb59660c232a8 Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesGetTestJSON-152150800 Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesGetTestJSON-152150800-project Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: ddd544f4e0af4f359003d46dbd59b78d Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesGetTestJSON-152150800-project Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '366edc37-3aca-4b0d-a95d-d950f04c288c'} Oct 17 17:56:10.282015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. (HTTP 404) (Request-ID: req-4b36adcf-f7d9-4846-a3cf-2cdb527fd7f3) Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:10.282962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:10.284509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 17:56:10.292176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a2324de-342c-41b0-9a27-6532632ea6d8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] Returning 404 to user: Volume 366edc37-3aca-4b0d-a95d-d950f04c288c could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:56:10.294191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5a2324de-342c-41b0-9a27-6532632ea6d8 tempest-VolumesGetTestJSON-152150800 tempest-VolumesGetTestJSON-152150800-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c" status: 404 len: 109 microversion: 2.1 time: 0.088780 Oct 17 17:56:10.296650 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 6/14] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:10 2022] GET /compute/v2.1/os-volumes/366edc37-3aca-4b0d-a95d-d950f04c288c => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:56:10.849847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b61d052d-975c-4119-a774-f97056c5b6e4 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196ffba60>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:11.139546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b61d052d-975c-4119-a774-f97056c5b6e4 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 200 len: 286 microversion: 2.1 time: 0.274091 Oct 17 17:56:11.139546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 9/15] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:10 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:12.126057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c66bdafe-9464-44f2-b71d-46d28dd8d3cb tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f019704bf70>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:12.207930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c66bdafe-9464-44f2-b71d-46d28dd8d3cb tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 200 len: 286 microversion: 2.1 time: 0.085784 Oct 17 17:56:12.208929 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 7/16] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:12 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:56:13.225703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c92332d1-ef13-47cf-ac6b-eb5f735f6381 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0197016550>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:13.285740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c92332d1-ef13-47cf-ac6b-eb5f735f6381 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 200 len: 287 microversion: 2.1 time: 0.069071 Oct 17 17:56:13.288295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 10/17] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:13 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:13.306035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c716a0b5-b554-4916-bbd0-1f3c286ad53f tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196fcf310>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:13.486333 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c716a0b5-b554-4916-bbd0-1f3c286ad53f tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 202 len: 0 microversion: 2.1 time: 0.189691 Oct 17 17:56:13.491239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 8/18] 10.222.0.58 () {58 vars in 1254 bytes} [Mon Oct 17 17:56:13 2022] DELETE /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 17:56:13.503317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f4bc20ed-c973-4a5b-ace5-242af58f60e0 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196ffbd30>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:13.623515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f4bc20ed-c973-4a5b-ace5-242af58f60e0 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 200 len: 286 microversion: 2.1 time: 0.128876 Oct 17 17:56:13.623515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 11/19] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:13 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:14.635404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b3086674-58a8-46b0-8d06-e310035d5532 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f019704b430>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-b3086674-58a8-46b0-8d06-e310035d5532 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] HTTP exception thrown: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b3086674-58a8-46b0-8d06-e310035d5532 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Request method failure captured: Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 HTTP/1.1 Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZczXrtNmSJsnZuek-ws2RvUbis2IrJWMFsfIlSA1OuV0-SvtniKaROUg4IPdWahtyfbJNIV_RG2pBhI7cvLM4ubxuD7ysQzX0M8GgpheKE0evoUVDV_F2vHTxf-kbNYqZaYLO0SOND__syzTelbhFeCoY-AWDvdaVkxiMY_c7k3y_Q Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:56:14.698440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69b8e5bcf7234e5b99f86d4e1aed0bc9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}] Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: e3cf780d06e2462c9e68a4ec18130a4d Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '71f1a07f-9b63-48c9-bb7e-0471e626e799'} Oct 17 17:56:14.699902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. (HTTP 404) (Request-ID: req-5417141e-2950-489b-87d2-3b6011f57d04) Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.700762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:14.701863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 17:56:14.703122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b3086674-58a8-46b0-8d06-e310035d5532 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Returning 404 to user: Snapshot 71f1a07f-9b63-48c9-bb7e-0471e626e799 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b3086674-58a8-46b0-8d06-e310035d5532 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799" status: 404 len: 111 microversion: 2.1 time: 0.066656 Oct 17 17:56:14.704610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 9/20] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 17 17:56:14 2022] GET /compute/v2.1/os-snapshots/71f1a07f-9b63-48c9-bb7e-0471e626e799 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:56:14.718641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a7dd61a8-1b54-4386-86b3-bc3d3cf33df4 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196ffb5e0>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:15.106885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a7dd61a8-1b54-4386-86b3-bc3d3cf33df4 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 202 len: 0 microversion: 2.1 time: 0.394712 Oct 17 17:56:15.108122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 12/21] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 17:56:14 2022] DELETE /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 17:56:15.119716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f8c71e5e-1d56-4f4a-ac3e-4e31a33aa000 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196fcfa60>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:15.187201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f8c71e5e-1d56-4f4a-ac3e-4e31a33aa000 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 200 len: 345 microversion: 2.1 time: 0.071363 Oct 17 17:56:15.195094 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 10/22] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:15 2022] GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:16.203149 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c93c4a44-7985-4bc8-a05c-340112489e7e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f019704be50>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:16.266568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-c93c4a44-7985-4bc8-a05c-340112489e7e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] HTTP exception thrown: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c93c4a44-7985-4bc8-a05c-340112489e7e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Request method failure captured: Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e HTTP/1.1 Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZczXrtNmSJsnZuek-ws2RvUbis2IrJWMFsfIlSA1OuV0-SvtniKaROUg4IPdWahtyfbJNIV_RG2pBhI7cvLM4ubxuD7ysQzX0M8GgpheKE0evoUVDV_F2vHTxf-kbNYqZaYLO0SOND__syzTelbhFeCoY-AWDvdaVkxiMY_c7k3y_Q Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:56:16.268535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69b8e5bcf7234e5b99f86d4e1aed0bc9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}] Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: e3cf780d06e2462c9e68a4ec18130a4d Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'c89fcd29-68b3-48ae-a13b-0d28b5f78b9e'} Oct 17 17:56:16.271521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. (HTTP 404) (Request-ID: req-825be9eb-0b37-4f21-a7c5-fa70adefa0fa) Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.272352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:16.275253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 17:56:16.278763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c93c4a44-7985-4bc8-a05c-340112489e7e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Returning 404 to user: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c93c4a44-7985-4bc8-a05c-340112489e7e tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 404 len: 109 microversion: 2.1 time: 0.070968 Oct 17 17:56:16.282171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:16 2022] GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 17:56:16.285095 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-17b59b73-dbb7-4d94-883d-9aeffead8597 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f0196fcf8b0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:16.373292 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-17b59b73-dbb7-4d94-883d-9aeffead8597 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] HTTP exception thrown: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-17b59b73-dbb7-4d94-883d-9aeffead8597 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Request method failure captured: Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e HTTP/1.1 Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZczXrtNmSJsnZuek-ws2RvUbis2IrJWMFsfIlSA1OuV0-SvtniKaROUg4IPdWahtyfbJNIV_RG2pBhI7cvLM4ubxuD7ysQzX0M8GgpheKE0evoUVDV_F2vHTxf-kbNYqZaYLO0SOND__syzTelbhFeCoY-AWDvdaVkxiMY_c7k3y_Q Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:56:16.385471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69b8e5bcf7234e5b99f86d4e1aed0bc9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}] Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: e3cf780d06e2462c9e68a4ec18130a4d Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'c89fcd29-68b3-48ae-a13b-0d28b5f78b9e'} Oct 17 17:56:16.387227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. (HTTP 404) (Request-ID: req-d1745d72-ee9e-424b-a689-0a411a2dfe86) Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.388506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 17:56:16.393272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 17:56:16.394418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-17b59b73-dbb7-4d94-883d-9aeffead8597 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Returning 404 to user: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-17b59b73-dbb7-4d94-883d-9aeffead8597 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 404 len: 109 microversion: 2.1 time: 0.109741 Oct 17 17:56:16.396180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 12/24] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 17:56:16 2022] DELETE /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:56:16.407545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-719d7453-8235-41a6-ae6e-0b08b2d14423 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Calling method '.version_select at 0x7f019704bf70>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:16.479862 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-505691322", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:16.497991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-719d7453-8235-41a6-ae6e-0b08b2d14423 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] HTTP exception thrown: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-719d7453-8235-41a6-ae6e-0b08b2d14423 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Request method failure captured: Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e HTTP/1.1 Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZczXrtNmSJsnZuek-ws2RvUbis2IrJWMFsfIlSA1OuV0-SvtniKaROUg4IPdWahtyfbJNIV_RG2pBhI7cvLM4ubxuD7ysQzX0M8GgpheKE0evoUVDV_F2vHTxf-kbNYqZaYLO0SOND__syzTelbhFeCoY-AWDvdaVkxiMY_c7k3y_Q Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:56:16.500251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_69b8e5bcf7234e5b99f86d4e1aed0bc9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/69b8e5bcf7234e5b99f86d4e1aed0bc9"}]}] Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 69b8e5bcf7234e5b99f86d4e1aed0bc9 Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-830011003 Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: e3cf780d06e2462c9e68a4ec18130a4d Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesSnapshotsTestJSON-830011003-project Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'c89fcd29-68b3-48ae-a13b-0d28b5f78b9e'} Oct 17 17:56:16.501599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. (HTTP 404) (Request-ID: req-4413b1fb-5838-4b7c-8e69-648f7bf9c707) Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.502373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 17:56:16.505407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 17:56:16.508032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-719d7453-8235-41a6-ae6e-0b08b2d14423 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] Returning 404 to user: Volume c89fcd29-68b3-48ae-a13b-0d28b5f78b9e could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:56:16.513771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-719d7453-8235-41a6-ae6e-0b08b2d14423 tempest-VolumesSnapshotsTestJSON-830011003 tempest-VolumesSnapshotsTestJSON-830011003-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e" status: 404 len: 109 microversion: 2.1 time: 0.114839 Oct 17 17:56:16.515821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:16 2022] GET /compute/v2.1/os-volumes/c89fcd29-68b3-48ae-a13b-0d28b5f78b9e => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:56:16.678486 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] validate_networks() for [('f34f9ee2-0de6-411c-a470-1298193c82aa', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:56:18.424533 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:56:18.425162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:56:18.425438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:56:18.426205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:56:18.426492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:56:18.476798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:18.477304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:18.485232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:18.491323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:18.499786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:18.499786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:18.585359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for project 54dacea98b1448ab828595f9e1c31a13. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:18.623948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for user af69042a7ac34adb92bae0288e51aa76 and project 54dacea98b1448ab828595f9e1c31a13. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:18.679738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:56:18.698632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:56:18.987804 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-41a904ad-42a5-41f8-a06c-f111c32a2398 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.137558 Oct 17 17:56:18.988799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 13/26] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:56:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:56:19.001772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e978457d-602e-4132-ae3a-a443b33f4d35 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:19.003845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e978457d-602e-4132-ae3a-a443b33f4d35 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:19.364491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e978457d-602e-4132-ae3a-a443b33f4d35 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:19.401640 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e978457d-602e-4132-ae3a-a443b33f4d35 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1221 microversion: 2.1 time: 0.404122 Oct 17 17:56:19.409169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 14/27] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:18 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1221 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:20.070811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-513945279", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:20.181554 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] validate_networks() for [('f34f9ee2-0de6-411c-a470-1298193c82aa', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:56:20.902327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1018498890", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "networks": [{"uuid": "e7e5a3ae-110e-4f69-9587-610ffc2c7fd8"}]}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:21.182323 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] validate_networks() for [('e7e5a3ae-110e-4f69-9587-610ffc2c7fd8', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:56:21.296782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:56:21.305948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:56:21.305948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:56:21.305948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:56:21.305948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:56:21.322178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:21.325663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:21.326780 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:21.333770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:21.333770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:21.333770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:21.383580 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for project 54dacea98b1448ab828595f9e1c31a13. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:21.397324 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for user af69042a7ac34adb92bae0288e51aa76 and project 54dacea98b1448ab828595f9e1c31a13. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:21.461023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:56:21.461023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:56:21.873831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f172117c-21e7-4cea-9f68-ea0a224576f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.807779 Oct 17 17:56:21.877451 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 14/28] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:56:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:56:22.297442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d9e05e30-8d9a-4223-a35b-d3955c35172d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'create', calling method: .version_select at 0x7f0196f0f9d0>, body: {"keypair": {"name": "tempest-keypair-554265394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCtMH3Zat4CiLI9ADimY/fdhTqnbQJrpnVz/ve2Dw53wW0rHE8DPlLjpmisjmr4yyK6VyecG8D+LdYpOnNC0D+TCcpK38Ew+ZRXJt7DfSvK+DkluEaJ+7tNZTjWOsH/SQ=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:22.369884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-d9e05e30-8d9a-4223-a35b-d3955c35172d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for project b8272c0b90914361ae6f6c3a062380df. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:22.376337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-d9e05e30-8d9a-4223-a35b-d3955c35172d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for user 31a5d88c557c45b38724e8dafc0d0296 and project b8272c0b90914361ae6f6c3a062380df. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:22.537686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d9e05e30-8d9a-4223-a35b-d3955c35172d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.654679 Oct 17 17:56:22.537686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 15/29] 10.222.0.58 () {62 vars in 1200 bytes} [Mon Oct 17 17:56:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 656 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 17:56:22.979229 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-92d09e64-659d-41a8-bd16-ca4f2254f204 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: .version_select at 0x7f01966ae670>, body: {"keypair": {"name": "tempest-keypair-398426015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjcD2E+CBaXFiBDxEIX/NyPmZ8V/uRUEEPSe08qXoR0jFgniiY0laI8y+1QQG0d8BGVW1IB5+1+5iqO48WuiqsRLv+gSmmXCNneAUb4ASR+LN7v/q3qG0LHKtxUUxdszg=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:23.093267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-92d09e64-659d-41a8-bd16-ca4f2254f204 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:23.113604 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-92d09e64-659d-41a8-bd16-ca4f2254f204 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:23.284215 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-92d09e64-659d-41a8-bd16-ca4f2254f204 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.748280 Oct 17 17:56:23.285368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 16/30] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 17:56:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:23.291320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-79a2582d-3aba-4366-bac2-fa52f83fdb26 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:23.297498 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-79a2582d-3aba-4366-bac2-fa52f83fdb26 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:23.665824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-79a2582d-3aba-4366-bac2-fa52f83fdb26 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:23.720484 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-79a2582d-3aba-4366-bac2-fa52f83fdb26 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1221 microversion: 2.1 time: 0.432851 Oct 17 17:56:23.723923 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 17/31] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:23 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1221 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:23.891878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:56:23.891878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:56:23.891878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:56:23.891878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:56:23.891878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:56:23.937682 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:23.951082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:23.951862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:23.958439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:23.959740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:23.960326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:24.087445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Getting quotas for project 5dbc86a8dc5a437ba59bd4ce6686d326. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:24.106144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Getting quotas for user e22168d7fce44adbbe055c2f1e0dcf1b and project 5dbc86a8dc5a437ba59bd4ce6686d326. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:24.133468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:56:24.137214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:56:24.525591 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c56b7b51-5794-4be5-a278-f43da06ecf84 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.202313 Oct 17 17:56:24.534474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 15/32] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:56:24.545181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fa5b9f70-2e0b-4bdf-b642-4f1f329185c5 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:24.545181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fa5b9f70-2e0b-4bdf-b642-4f1f329185c5 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:24.750023 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:24.751125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:24.770151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:24.781390 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:24.784201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:24.793218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:24.797570 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:24.802380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:24.852371 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fa5b9f70-2e0b-4bdf-b642-4f1f329185c5 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:24.864509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fa5b9f70-2e0b-4bdf-b642-4f1f329185c5 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1215 microversion: 2.1 time: 0.329063 Oct 17 17:56:24.877035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 18/33] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:24 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:25.267206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:25.305907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-638cc136-e883-4e7f-92fc-850fc20fa31d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1217 microversion: 2.1 time: 0.562405 Oct 17 17:56:25.306919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 16/34] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:24 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1217 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:25.900476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4ff0c78e-2253-4884-bcf7-0ff084dc86dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:25.900476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4ff0c78e-2253-4884-bcf7-0ff084dc86dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:26.148034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4ff0c78e-2253-4884-bcf7-0ff084dc86dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:26.165529 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4ff0c78e-2253-4884-bcf7-0ff084dc86dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1215 microversion: 2.1 time: 0.275633 Oct 17 17:56:26.211086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 19/35] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:25 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:26.332202 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:26.332997 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:26.344289 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:26.345035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:26.345761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:26.346928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:26.347645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:26.348703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:26.647459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3dd4b2a9-64ee-429f-b8bd-5e92f894347f tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196665430>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:26.914939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3dd4b2a9-64ee-429f-b8bd-5e92f894347f tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1834ab4c-6ff2-428a-9e3f-fb1ce2c1f236" status: 200 len: 351 microversion: 2.1 time: 0.262053 Oct 17 17:56:26.914939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 20/36] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:26 2022] GET /compute/v2.1/os-volumes/1834ab4c-6ff2-428a-9e3f-fb1ce2c1f236 => generated 351 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:27.019050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:27.039105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-64fb67f2-aaaf-4db1-8754-987b0c2cc64d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1281 microversion: 2.1 time: 0.709347 Oct 17 17:56:27.062642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 17/37] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:26 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1281 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:27.195237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:27.195918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:27.211345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:27.211855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:27.220988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:27.221855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:27.222349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:27.222796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:28.072109 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:28.072987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:28.089653 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:28.090439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:28.091056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:28.093883 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:28.106348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:28.107163 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:28.255635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:28.294311 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1b26f302-2a88-460f-a434-aa5b1a952208 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1267 microversion: 2.1 time: 1.098676 Oct 17 17:56:28.294311 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 21/38] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:27 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1267 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:28.737312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:28.753481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c251949e-49d8-445f-809e-bff5f4dcd42a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1279 microversion: 2.1 time: 0.684588 Oct 17 17:56:28.773521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 18/39] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:28 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1279 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:29.205935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a08b6bad-e91b-49fa-9e1c-2d30011294fd tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f019659c940>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:29.322010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:29.322759 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:29.335354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:29.336556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:29.337513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:29.338582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:29.339214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:29.339813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:29.353088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a08b6bad-e91b-49fa-9e1c-2d30011294fd tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/acc02bc3-cf16-4be9-a4f7-a7807fef11fd" status: 200 len: 351 microversion: 2.1 time: 0.152516 Oct 17 17:56:29.354505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 22/40] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:29 2022] GET /compute/v2.1/os-volumes/acc02bc3-cf16-4be9-a4f7-a7807fef11fd => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:29.786096 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:29.787058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:29.800262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:29.802064 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:29.803081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:29.808343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:29.809118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:29.809811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:29.981292 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:30.018831 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1485fae0-f619-4d09-8052-494652f703d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1273 microversion: 2.1 time: 0.701649 Oct 17 17:56:30.029159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 19/41] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:29 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1273 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:30.083465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:30.104649 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9559f256-8eef-45cb-adf1-20a4bdb0a515 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1279 microversion: 2.1 time: 0.323675 Oct 17 17:56:30.108113 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 23/42] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:29 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1279 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:31.048903 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:31.049527 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:31.062198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:31.062725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:31.063175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:31.063886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:31.064350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:31.064812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:31.094175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1500252699", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a6940ab-f26f-4946-9f58-3b74b9998843"}], "security_groups": [{"name": "tempest-securitygroup--1764004478"}], "key_name": "tempest-keypair-398426015", "user_data": "}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:31.357373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=4 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:31.394288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:31.409656 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2590ac90-c842-4c6b-8484-8c33d23991dc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1273 microversion: 2.1 time: 0.362131 Oct 17 17:56:31.413532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 20/43] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:31 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1273 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:31.433175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:31.436747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:31.463891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:31.467142 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:31.475074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:31.476084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:31.476878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:31.477465 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:32.034993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] validate_networks() for [('7a6940ab-f26f-4946-9f58-3b74b9998843', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:56:32.210603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:32.217370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3d03ae3c-4e85-4c2c-b514-90255856b61d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1279 microversion: 2.1 time: 0.801051 Oct 17 17:56:32.225573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:31 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1279 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:32.230943 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-60985b29-007e-4161-9989-42b2bdb2793c tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196574ee0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:32.340478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-60985b29-007e-4161-9989-42b2bdb2793c tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/64a80afc-c85e-4104-b4da-72b802f014c4" status: 200 len: 350 microversion: 2.1 time: 0.113264 Oct 17 17:56:32.341200 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 22/45] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 17:56:32 2022] GET /compute/v2.1/os-volumes/64a80afc-c85e-4104-b4da-72b802f014c4 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:32.356761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-52787180-4187-43a7-be2e-5e3b4877baba tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196615940>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:32.516410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-52787180-4187-43a7-be2e-5e3b4877baba tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.163634 Oct 17 17:56:32.517642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 23/46] 10.222.0.58 () {58 vars in 1134 bytes} [Mon Oct 17 17:56:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:32.525675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:32.528833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:32.558637 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:32.561484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:32.570257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:32.570257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:32.587790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:32.588823 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:33.865519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:33.912339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4eaec936-8f3f-4ce5-8b78-120857c1ba48 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 1.389823 Oct 17 17:56:33.919406 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 24/47] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:32 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:33.941804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ed39aa63-feae-4282-8eec-3ced0aa98cb8 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196574e50>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:34.022823 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:34.122606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=8 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:34.227663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ed39aa63-feae-4282-8eec-3ced0aa98cb8 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.306100 Oct 17 17:56:34.228751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1149 bytes} [Mon Oct 17 17:56:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:34.244455 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:34.245359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:34.255736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:34.257603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:34.257603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:34.264370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:34.264941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:34.265399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:34.308841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:56:34.309415 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:56:34.311370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:56:34.311818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:56:34.312300 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:56:34.337267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:34.337267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:34.337267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:34.337267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:34.337693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:34.337693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:34.369475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:34.386918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:34.431793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:56:34.439587 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:56:34.526432 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:34.549360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cd68b084-a644-48b4-92a5-a1b97aad61ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.319138 Oct 17 17:56:34.550237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 26/49] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:34 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:34.562039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cac2fab2-5bc7-4016-bf75-247782f253fd tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196574160>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:34.678312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ba003f2b-b45f-4c28-82e7-81d88bf288c3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.588502 Oct 17 17:56:34.685307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 24/50] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:56:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 3596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 17:56:34.697604 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2131773115", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "994c43a5-d813-4de6-ade7-7c63b869b2da"}], "security_groups": [{"name": "tempest-securitygroup--1579397847"}], "key_name": "tempest-keypair-554265394", "user_data": "}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:34.774363 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cac2fab2-5bc7-4016-bf75-247782f253fd tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.222895 Oct 17 17:56:34.774944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 27/51] 10.222.0.58 () {58 vars in 1134 bytes} [Mon Oct 17 17:56:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:34.779417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9a4c6557-c418-4077-ba3f-a52544595351 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:34.779970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9a4c6557-c418-4077-ba3f-a52544595351 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:35.138501 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9a4c6557-c418-4077-ba3f-a52544595351 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:35.146830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9a4c6557-c418-4077-ba3f-a52544595351 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1241 microversion: 2.1 time: 0.370811 Oct 17 17:56:35.147418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 28/52] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:34 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1241 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:35.153461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a44a9992-c7a9-4559-afd0-83f9c0b967b5 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196615ee0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:35.187340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] validate_networks() for [('994c43a5-d813-4de6-ade7-7c63b869b2da', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:56:35.390264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a44a9992-c7a9-4559-afd0-83f9c0b967b5 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.241548 Oct 17 17:56:35.391333 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 29/53] 10.222.0.58 () {58 vars in 1167 bytes} [Mon Oct 17 17:56:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:35.399972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:35.403134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:35.420849 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:35.422453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:35.425515 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:35.426972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:35.429669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:35.430491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:36.324507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:36.331129 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9115c3c1-87a7-487f-94e3-a9bb84735da0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.938589 Oct 17 17:56:36.347276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 30/54] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:35 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:36.370816 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-db4ed5c3-f52c-4700-8e07-53bc952260f3 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f0196fcfc10>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:36.533180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-db4ed5c3-f52c-4700-8e07-53bc952260f3 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.179893 Oct 17 17:56:36.533180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 31/55] 10.222.0.58 () {58 vars in 1170 bytes} [Mon Oct 17 17:56:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:36.534135 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:36.534860 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:36.547490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:36.549300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:36.549828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:36.554802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:36.555431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:36.555885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:37.052726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:37.073344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5fd24885-408b-4bda-8491-d9b54cf5f755 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.542451 Oct 17 17:56:37.078898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 32/56] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:36 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:37.084068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:37.086941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:37.101933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:37.102678 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:37.103261 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:37.108950 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:37.109797 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:37.112029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:37.114972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:56:37.116970 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:56:37.118069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:56:37.119039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:56:37.120062 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:56:37.141254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:37.142771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:37.143681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:37.144632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:37.145668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:37.146404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:37.236065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for project b8272c0b90914361ae6f6c3a062380df. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:56:37.251765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:37.262158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for user 31a5d88c557c45b38724e8dafc0d0296 and project b8272c0b90914361ae6f6c3a062380df. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:56:37.270540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:37.279668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-963f1c1b-4bf4-42a9-a419-61def249063f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1245 microversion: 2.1 time: 0.202446 Oct 17 17:56:37.280892 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 33/57] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:37 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1245 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:37.286887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-05a6a8c0-84cb-40f8-8933-aaf1a750eefd tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f01965b38b0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:37.296366 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:56:37.299327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:56:37.525601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-65029b51-a5a2-4771-b6ae-9008c4cf961c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.838883 Oct 17 17:56:37.526262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 25/58] 10.222.0.58 () {62 vars in 1188 bytes} [Mon Oct 17 17:56:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 17:56:37.542124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-05a6a8c0-84cb-40f8-8933-aaf1a750eefd tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.259851 Oct 17 17:56:37.543397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 34/59] 10.222.0.58 () {58 vars in 1155 bytes} [Mon Oct 17 17:56:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:37.550556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:37.556038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:37.600751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:37.600751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:37.600751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:37.600751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:37.601066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:37.601066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.172535 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d9533e-9953-4305-87cb-374cd49a00fc", "tag": "ab4d8739-36f3-4abd-a9e7-82aaa2a2076d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:38.201007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.201733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.202322 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.238693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Creating event network-changed:ab4d8739-36f3-4abd-a9e7-82aaa2a2076d for instance 46d9533e-9953-4305-87cb-374cd49a00fc on hv-cinder-86160 Oct 17 17:56:38.240124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 17:56:38.240930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7ca99c11-6de5-407a-bec3-dca1160bede0 req-5cc45d58-d291-484c-a441-aa48417f7f34 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 17:56:38.242181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.242794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.243359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.244223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.244939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.245695 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.258007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.compute.rpcapi [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 17:56:38.259112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] Releasing lock "compute-rpcapi-router" {{(pid=126519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 17:56:38.289114 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d2d27cde-84f0-4442-9dfa-4f4f1c0a1ac7 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.755824 Oct 17 17:56:38.289928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 26/60] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:38.299074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9d728d87-72c9-4874-9f18-e6ac0ee73c44 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:38.300668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9d728d87-72c9-4874-9f18-e6ac0ee73c44 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:38.435695 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9d728d87-72c9-4874-9f18-e6ac0ee73c44 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:38.487686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9d728d87-72c9-4874-9f18-e6ac0ee73c44 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:38.490033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9d728d87-72c9-4874-9f18-e6ac0ee73c44 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:38.492377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9d728d87-72c9-4874-9f18-e6ac0ee73c44 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1281 microversion: 2.20 time: 0.201030 Oct 17 17:56:38.517140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 27/61] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:38 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:38.529578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:38.537518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-da2253a5-8fc2-40f4-9179-0340d3c6a101 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f01965d8d30>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:38.543341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4dd3cecb-664a-4c95-8fe8-52a306e3106e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.997030 Oct 17 17:56:38.543341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 35/62] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:37 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:38.553269 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:38.559694 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:38.579665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.580295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.580777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.584398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.584902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.585338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.685430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-da2253a5-8fc2-40f4-9179-0340d3c6a101 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.166356 Oct 17 17:56:38.686968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 28/63] 10.222.0.58 () {58 vars in 1188 bytes} [Mon Oct 17 17:56:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:38.699597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:38.713283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:38.740218 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.742472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.743437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.745772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:38.747345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:38.748815 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:38.860396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:38.872502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2b935110-2878-46b6-a364-d623084ca996 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1293 microversion: 2.1 time: 0.181722 Oct 17 17:56:38.873617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 29/64] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:38 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1293 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:39.014874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:39.028662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-957e2b7e-e503-4151-83fb-971fe9285f0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.479783 Oct 17 17:56:39.029242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 36/65] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:38 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:39.039873 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5bda1b2e-d9f4-40b8-b684-9387c2dfc4a4 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] Calling method '.version_select at 0x7f019656c310>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:39.154873 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-44c10eb9-c17f-4332-8e8a-c2a2418041c0 req-2c70a388-c019-4d34-87c0-289ab307fd77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba64c9aa-8ed7-4020-8fcb-90e39eab659b", "tag": "d087c949-77fc-498e-902d-36ca8ef2c433"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:39.174370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-44c10eb9-c17f-4332-8e8a-c2a2418041c0 req-2c70a388-c019-4d34-87c0-289ab307fd77 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.174956 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-44c10eb9-c17f-4332-8e8a-c2a2418041c0 req-2c70a388-c019-4d34-87c0-289ab307fd77 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.177830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-44c10eb9-c17f-4332-8e8a-c2a2418041c0 req-2c70a388-c019-4d34-87c0-289ab307fd77 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:39.227557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-44c10eb9-c17f-4332-8e8a-c2a2418041c0 req-2c70a388-c019-4d34-87c0-289ab307fd77 service nova] Creating event network-changed:d087c949-77fc-498e-902d-36ca8ef2c433 for instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b on hv-cinder-86160 Oct 17 17:56:39.234802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-44c10eb9-c17f-4332-8e8a-c2a2418041c0 req-2c70a388-c019-4d34-87c0-289ab307fd77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359395 Oct 17 17:56:39.240163 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5bda1b2e-d9f4-40b8-b684-9387c2dfc4a4 tempest-VolumesTestJSON-975744074 tempest-VolumesTestJSON-975744074-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.208086 Oct 17 17:56:39.240323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 30/66] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:39.255521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 37/67] 10.222.0.58 () {58 vars in 1155 bytes} [Mon Oct 17 17:56:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:39.524842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:39.525533 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:39.545126 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.552106 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.565001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:39.566415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:39.566700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:39.574096 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.580119 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.580119 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:39.603075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.608938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.608938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:39.618214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.621194 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.622544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:39.822098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:39.837799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:39.847029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:39.852346 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b356a8e3-5a6b-492c-bbec-f9cca6ce46f7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1285 microversion: 2.20 time: 0.330942 Oct 17 17:56:39.853664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 31/68] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:39 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:39.909056 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:39.909819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:39.936562 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.938466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.939707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:39.940314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:39.940818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:39.941852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.139551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:40.159461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9a563d80-cece-41a7-8cce-fb2eda3e7a7a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1299 microversion: 2.1 time: 0.258885 Oct 17 17:56:40.176795 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 32/69] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:39 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:40.188980 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:40.194665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:40.208567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.209888 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.210365 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.211108 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.211574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.212009 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.215705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:40.226165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a1c8ba4d-8fe9-451f-91e9-e0be07c64b1b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.665077 Oct 17 17:56:40.236891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 38/70] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:39 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:40.405566 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab22d3f-2eb8-4622-811d-504c4946430f", "tag": "7b80a0c2-2a89-4a4b-ace3-0289c5a2c037"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:40.434435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.435582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.436827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.499787 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Creating event network-changed:7b80a0c2-2a89-4a4b-ace3-0289c5a2c037 for instance 0ab22d3f-2eb8-4622-811d-504c4946430f on hv-cinder-86160 Oct 17 17:56:40.509217 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126522) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 17:56:40.509780 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8289f433-ec09-4536-bdcb-99323204ca87 req-1701bf78-dab2-4f00-8115-83a8583fcb62 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126522) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 17:56:40.511301 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.522374 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.523125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.525547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.526242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.528762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.530614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:40.544714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-aeba3642-2841-4bb2-9833-182c5c7f8d15 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.364588 Oct 17 17:56:40.545751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 33/71] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:40 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:40.550562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.compute.rpcapi [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 17:56:40.553175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] Releasing lock "compute-rpcapi-router" {{(pid=126522) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 17:56:40.575943 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e3cc767c-b9a2-44d6-86c4-157afc6630ea None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187624 Oct 17 17:56:40.576895 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 39/72] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:56:40.887706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:40.889040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:40.898215 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.899936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.904071 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:40.905241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:40.906001 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:40.906598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.191562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:41.196316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:41.213467 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:41.226131 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:41.227593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:41.228261 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:41.228802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.235339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:41.237025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:41.237617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:41.238062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.241416 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e8bb3012-fb7a-4bd9-bb93-9d47deb99b3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1333 microversion: 2.20 time: 0.365790 Oct 17 17:56:41.242260 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 34/73] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:40 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1333 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:41.518636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:41.518636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:41.518636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:41.518636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:41.521092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.521092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:41.521092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:41.521092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.521866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:41.521866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2c6a10ee-7816-46d2-8ae4-bc5daebbc76b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1299 microversion: 2.1 time: 0.284213 Oct 17 17:56:41.521866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 40/74] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:41 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:41.583487 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:41.584377 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:41.609073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:41.612168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:41.613600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.616831 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:41.618936 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:41.621360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:41.651198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:41.987913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:41.997555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b6c8eb28-c4b8-45bd-b105-5f38df236f05 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.747937 Oct 17 17:56:42.011244 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 35/75] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:41 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:42.105249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:42.113942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-baaeda01-8877-49e3-8822-9e49bc34f7ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.549364 Oct 17 17:56:42.125563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 41/76] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:41 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:42.269841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:42.271256 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:42.278777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:42.279253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:42.279738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:42.280453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:42.281203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:42.281636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:42.374928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:42.394485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:42.400893 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:42.408102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ed18d6e4-ba97-4505-88c7-1531a8976789 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1333 microversion: 2.20 time: 0.142138 Oct 17 17:56:42.412505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 36/77] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:42 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1333 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:42.542335 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:42.543161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:42.562481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:42.562990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:42.563425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:42.564140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:42.564619 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:42.578038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:42.953558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:42.982503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-726fb4b7-373d-48a0-a402-a640a8b5bc69 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.445755 Oct 17 17:56:42.984658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 42/78] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:42 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:43.025706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:43.029369 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:43.050675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:43.053389 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:43.054221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:43.055041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:43.059389 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:43.059928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:43.142388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:43.143196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:43.156771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:43.159364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:43.161633 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:43.163706 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:43.165469 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:43.166614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:43.734204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:43.750304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-909b8867-b967-43c7-b3d9-ab6b726d9077 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.612164 Oct 17 17:56:43.760809 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 43/79] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:43 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:43.773822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:43.773822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:43.783312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:43.783740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:43.784175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:43.786380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:43.786955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:43.787396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:43.926544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:43.945571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-51d3ef32-a662-4a1f-b443-8e5b52b447e6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.922855 Oct 17 17:56:43.945571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 37/80] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:43 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:44.008427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:44.008986 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:44.015453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.016149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.016791 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:44.017614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.018064 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.018486 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:44.038479 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:44.047663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:44.049919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:44.051896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2b6a1652-46ba-4e5f-a6fa-6b99e0ee7774 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1339 microversion: 2.20 time: 0.289479 Oct 17 17:56:44.052954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 44/81] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:43 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1339 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:44.233530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:44.247155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fc522ef8-a178-4e21-8017-3c5075a71d55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.239965 Oct 17 17:56:44.261053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 38/82] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:44 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:44.777748 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:44.778560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:44.784039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:44.788908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.788908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.788908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:44.788908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.789399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.789399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:44.916942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-a449f14d-c0c1-433d-90b4-abc8beaa74b9 req-a1a52c3a-cec2-4c52-b536-75eae9b2fa1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4103da-d0cb-4d9c-b475-e0ee08b57398", "tag": "6f031636-bf67-4c5d-9a2a-708b298712ca"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:44.932957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a449f14d-c0c1-433d-90b4-abc8beaa74b9 req-a1a52c3a-cec2-4c52-b536-75eae9b2fa1b service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.932957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a449f14d-c0c1-433d-90b4-abc8beaa74b9 req-a1a52c3a-cec2-4c52-b536-75eae9b2fa1b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.932957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a449f14d-c0c1-433d-90b4-abc8beaa74b9 req-a1a52c3a-cec2-4c52-b536-75eae9b2fa1b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:44.933575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=81 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:44.943910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-a449f14d-c0c1-433d-90b4-abc8beaa74b9 req-a1a52c3a-cec2-4c52-b536-75eae9b2fa1b service nova] Creating event network-changed:6f031636-bf67-4c5d-9a2a-708b298712ca for instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 on hv-cinder-86160 Oct 17 17:56:44.949107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-a449f14d-c0c1-433d-90b4-abc8beaa74b9 req-a1a52c3a-cec2-4c52-b536-75eae9b2fa1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Oct 17 17:56:44.954750 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 39/83] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:44.968153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:44.968896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:44.975843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.976538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.977246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:44.978108 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:44.978724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:44.979156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:45.045366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:45.055649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fdaa78f7-a6d7-452c-ae6f-53225e912b95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.283303 Oct 17 17:56:45.058263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 45/84] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:44 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:45.080213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:45.080854 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:45.087748 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:45.092316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:45.092316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:45.092316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:45.092316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:45.092669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:45.143605 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:45.196359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:45.204302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a937c025-c98a-44e1-8e21-e97dfb30e772 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.240718 Oct 17 17:56:45.204905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 40/85] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:44 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:45.240885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:45.248939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:45.250371 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:45.251460 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-792018c5-dbb0-47ed-aaea-5d50cbfd5b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.175735 Oct 17 17:56:45.252010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 46/86] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:45 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:45.273496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:45.274029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:45.279799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:45.280281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:45.280802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:45.283024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:45.283488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:45.283913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:45.422723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:45.435142 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f600fb63-00f3-4922-9d5a-cb31eff8493d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.165520 Oct 17 17:56:45.444940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 41/87] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:45 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:46.082877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:46.083568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:46.090276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.090771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.091424 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.092255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.092742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.093102 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.228638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:46.229286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:46.239535 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.241217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.241667 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.242389 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.242851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.243282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.259365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:46.271928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d4deda68-8291-468a-bee4-cd1e8e2c0985 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.191250 Oct 17 17:56:46.291236 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 47/88] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:46 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:46.306039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:46.306039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:46.316994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.321216 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.321777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.323198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.323786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.324315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.502473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:46.513712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:46.523130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:46.525731 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-28fd3812-e064-4aed-990d-9d9ca0d1c253 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.302319 Oct 17 17:56:46.536931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 42/89] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:46 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:46.536931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:46.536931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:46.537266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:46.537266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-490b1dbc-e596-41f5-b105-89d0a2943f3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.242923 Oct 17 17:56:46.537266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 48/90] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:46 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:46.542128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.542692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.543195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.543973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:46.544472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:46.545000 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:46.695724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:46.703281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1829b670-0cfa-4062-8c34-0a09b50e0c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.175891 Oct 17 17:56:46.703852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 43/91] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:46 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:47.169771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-5c22f758-142e-476f-b5c0-a3d330b8f077 req-f1109b65-6acf-4f51-a58a-c839a655b0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:47.180793 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-5c22f758-142e-476f-b5c0-a3d330b8f077 req-f1109b65-6acf-4f51-a58a-c839a655b0e0 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.181268 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-5c22f758-142e-476f-b5c0-a3d330b8f077 req-f1109b65-6acf-4f51-a58a-c839a655b0e0 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.181693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-5c22f758-142e-476f-b5c0-a3d330b8f077 req-f1109b65-6acf-4f51-a58a-c839a655b0e0 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.193636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-5c22f758-142e-476f-b5c0-a3d330b8f077 req-f1109b65-6acf-4f51-a58a-c839a655b0e0 service nova] Creating event network-changed:159ad1ae-f38b-4dca-afd5-a41b7031cb8c for instance d932b27f-b1fd-42b4-a8e3-3908063839da on hv-cinder-86160 Oct 17 17:56:47.199445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-5c22f758-142e-476f-b5c0-a3d330b8f077 req-f1109b65-6acf-4f51-a58a-c839a655b0e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033999 Oct 17 17:56:47.200046 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 49/92] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:47.305315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:47.306053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:47.312166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.312688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.313126 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.313823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.314457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.314885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.451648 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:47.459946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-85470a77-c78a-4b0b-9444-25148351f4a6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.158988 Oct 17 17:56:47.460519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 44/93] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:47 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:47.569771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:47.570589 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:47.571274 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:47.571880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:47.580918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.580918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.581091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.581177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.581258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.581258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.581436 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.581436 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.581577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.581657 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.581737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.581737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.777564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:47.780860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:47.785925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9340ec9b-e1f5-4d3f-b9a2-d970b94d53c2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.220516 Oct 17 17:56:47.787071 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 50/94] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:47 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:47.792346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:47.793084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:47.799560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.803606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.803606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.803606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:47.803606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:47.803925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:47.825686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:47.827124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:47.828282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8df6bec5-b425-409e-b620-873155154be7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.261081 Oct 17 17:56:47.833177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 45/95] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:47 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:47.938952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:47.947417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cb60bffd-df7b-4e3a-b9b5-866ece21d28b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.158777 Oct 17 17:56:47.948001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 51/96] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:47 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:48.482592 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:48.483198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:48.486308 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:48.486960 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=40 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:48.491226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:48.491708 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:48.492141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:48.492855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:48.493307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:48.493729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:48.636161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:48.644143 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c6b0d065-093e-4e6e-b36f-8a1da3563422 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.165309 Oct 17 17:56:48.644736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 46/97] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:48 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:48.813386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:48.813990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:48.820330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:48.820924 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:48.826422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:48.826422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:48.826422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:48.826422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:48.861286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:48.861286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:48.870274 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:48.870761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:48.871193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:48.871923 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:48.872723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:48.873187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:49.042681 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:49.053042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f2d07d0a-9418-499f-ae39-63f2dcf4be17 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.242948 Oct 17 17:56:49.054276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 52/98] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:48 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:49.060188 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:49.061011 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:49.083712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:49.103912 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:49.104120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:49.104120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:49.104120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:49.104120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:49.104426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:49.104519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:49.104519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:49.104700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8a2479df-497f-4059-b9f3-3dcf4d3a15d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.247586 Oct 17 17:56:49.104700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 47/99] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:48 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:49.257363 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:49.265544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ebafb287-0b1b-4855-8693-d705b599eed4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.209647 Oct 17 17:56:49.266310 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 53/100] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:49 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:49.668984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:49.669751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:49.677607 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:49.678429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:49.679805 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:49.680545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:49.681363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:49.681822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.077148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:50.078454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:50.087420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:50.088183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:50.088863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.089767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:50.090415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:50.091046 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.233099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:50.250948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a398bc2e-e3a3-4284-9403-9911d4ae85dd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.586145 Oct 17 17:56:50.251915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 48/101] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:49 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:50.257550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:50.264549 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:50.275083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:50.275083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:50.283297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.284336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:50.285086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:50.285516 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.544235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:50.544235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:50.551355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-79572c23-5ab6-41c0-876a-7cb7093a05d0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.477890 Oct 17 17:56:50.552001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 54/102] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:50 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:50.573175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:50.573790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:50.580747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:50.581273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:50.581711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.582416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:50.583503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:50.584227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:50.676018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:50.688857 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:50.693078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:50.694909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ad17ed6c-4cee-4b8f-9125-f4895526efc5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.441779 Oct 17 17:56:50.695840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 49/103] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:50 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:50.824315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:50.836556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ec1ebb04-4a76-4434-bd71-b88975a6d282 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.270142 Oct 17 17:56:50.838313 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 55/104] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:50 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:51.277336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:51.277936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:51.284449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.284974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.291013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.291013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.291013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.291013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.423940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:51.434830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-aac40d18-2f78-4a07-a1b4-9f3e735b2c9c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.159326 Oct 17 17:56:51.434830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 50/105] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:51 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:51.576801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:51.577516 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:51.584837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.585314 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.585742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.586425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.586869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.587487 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.722310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:51.723088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:51.727113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:51.730076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.730626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.731065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.735120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.735120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.735120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.735851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-256ea4e0-96a5-4962-9c99-30eb1602c244 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.162292 Oct 17 17:56:51.738198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 56/106] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:51 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:51.865657 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:51.866615 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:51.867547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:51.873574 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.873743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:51.874051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.874638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:51.875135 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:51.876258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1f17d640-c987-41e6-9b5d-6aa79915aedd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.157957 Oct 17 17:56:51.877000 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 51/107] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:51 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:51.882128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:51.882774 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:51.883340 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:52.020845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:52.029081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-39770305-a10e-4484-bf99-040633c2e3d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.173469 Oct 17 17:56:52.029645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 57/108] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:51 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:52.458233 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:52.458798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:52.464806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:52.465293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:52.465723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:52.466424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:52.466877 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:52.467367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:52.612616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:52.620622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0382af7c-674e-4964-a301-dd8996f45c2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.166259 Oct 17 17:56:52.621210 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 52/109] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:52 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:52.758633 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:52.759887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:52.765798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:52.769603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:52.769603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:52.769603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:52.769603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:52.769931 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:52.899058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:52.902440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:52.902897 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:52.903036 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:52.907875 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c35ae153-578c-4bfa-9afa-5bb230dacbf9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.153758 Oct 17 17:56:52.908452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 58/110] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:52 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:52.909725 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:52.910426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:52.910910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:52.911723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:52.912368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:52.913740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:53.040333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:53.048733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:53.050430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:53.052029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-37303d0e-2768-4254-b1b7-e2e02de5bc78 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.152993 Oct 17 17:56:53.053222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 53/111] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:52 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:53.054604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:53.055227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:53.061189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:53.061664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:53.062096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:53.062916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:53.063376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:53.063801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:53.237660 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:53.246550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-72105c01-4b88-4bac-bd61-4363a7ab2427 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.198393 Oct 17 17:56:53.247137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 59/112] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:53 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:56:53.644187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:53.644903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:53.653206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:53.653206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:53.653206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:53.653206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:53.653557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:53.653675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:53.790173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:53.797971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-653cf75a-17c9-42cc-86b8-3755bf0aa225 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.158525 Oct 17 17:56:53.798538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 54/113] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:53 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:53.931952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:53.932681 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:53.938791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:53.939273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:53.939706 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:53.940478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:53.940961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:53.941388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.079731 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:54.081173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:54.086691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:54.089866 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.092522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.092522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.092522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.092522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.093083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.104032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-93613c8c-90e5-456b-889a-0cd6e41bd099 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.176152 Oct 17 17:56:54.105037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 60/114] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:53 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:54.227283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:54.236762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:54.238678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:54.240868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d9622357-35cd-49b7-9b9e-45c5e5882069 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.165253 Oct 17 17:56:54.241570 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 55/115] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:54 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:54.268804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:54.269406 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:54.276169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.276671 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.277105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.277777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.278379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.278794 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.425639 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:54.433439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c12c2605-536a-4023-be8f-c249d6cd73af tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.168415 Oct 17 17:56:54.434006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 61/116] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:54 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:54.518562 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-3eaafd24-b568-4c88-a02c-68461bcce3c5 req-47a3b159-763f-4231-905c-8124ebb0f6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d9533e-9953-4305-87cb-374cd49a00fc", "name": "network-vif-plugged", "status": "completed", "tag": "ab4d8739-36f3-4abd-a9e7-82aaa2a2076d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:54.538205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-3eaafd24-b568-4c88-a02c-68461bcce3c5 req-47a3b159-763f-4231-905c-8124ebb0f6ca service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.539174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-3eaafd24-b568-4c88-a02c-68461bcce3c5 req-47a3b159-763f-4231-905c-8124ebb0f6ca service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.541174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-3eaafd24-b568-4c88-a02c-68461bcce3c5 req-47a3b159-763f-4231-905c-8124ebb0f6ca service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.563290 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-3eaafd24-b568-4c88-a02c-68461bcce3c5 req-47a3b159-763f-4231-905c-8124ebb0f6ca service nova] Creating event network-vif-plugged:ab4d8739-36f3-4abd-a9e7-82aaa2a2076d for instance 46d9533e-9953-4305-87cb-374cd49a00fc on hv-cinder-86160 Oct 17 17:56:54.571046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-3eaafd24-b568-4c88-a02c-68461bcce3c5 req-47a3b159-763f-4231-905c-8124ebb0f6ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121588 Oct 17 17:56:54.572361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 56/117] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:54.821305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:54.822201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:54.833514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.837692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.838392 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:54.839492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:54.839971 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:54.840794 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.002593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:55.011617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-da61bd8a-30bd-45a3-aba3-7eddc37e62eb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.194520 Oct 17 17:56:55.015960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 62/118] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:54 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:55.127651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:55.128338 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:55.136187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:55.136701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:55.137142 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.137840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:55.138303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:55.138730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.143664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:56:55.270031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:55.271581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:55.281275 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:55.281967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:55.282539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.284788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:55.285095 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:55.287329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.303403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:55.312610 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cd9d7c88-6f5f-483b-ab0f-ef609c72db5b tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.189041 Oct 17 17:56:55.313634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 57/119] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:55 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:55.440222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:55.450057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:55.451429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:55.452786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-68553275-85c9-4b20-9bcf-31c29373afd9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.189841 Oct 17 17:56:55.453762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 63/120] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:55 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:55.476757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:55.477552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:55.503913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:55.504455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:55.505614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.506501 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:55.507188 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:55.507625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:55.755316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:55.769038 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4953e6a8-53b4-411e-8494-4289c059c657 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.314916 Oct 17 17:56:55.781180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 58/121] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:55 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:56.041699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:56.042958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:56.048206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.048715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.049142 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.050084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.050528 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.050939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.205544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:56.214940 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cc494b7a-f828-4f0e-9fb4-26b5879d2673 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.176043 Oct 17 17:56:56.215896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 64/122] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:56 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:56.337221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:56.338500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:56.344959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.345441 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.345880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.346689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.347141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.347628 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.478209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:56.479012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:56.485141 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.485613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.486203 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.486907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.487510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.488109 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.499405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:56.509204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-586e7dca-ce67-433f-9f4c-d7049af2c526 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.174597 Oct 17 17:56:56.509204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 59/123] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:56 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:56.593608 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba64c9aa-8ed7-4020-8fcb-90e39eab659b", "name": "network-vif-plugged", "status": "completed", "tag": "d087c949-77fc-498e-902d-36ca8ef2c433"}, {"server_uuid": "0ab22d3f-2eb8-4622-811d-504c4946430f", "name": "network-vif-plugged", "status": "completed", "tag": "7b80a0c2-2a89-4a4b-ace3-0289c5a2c037"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:56:56.606533 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.607251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.607679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.622510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] Creating event network-vif-plugged:d087c949-77fc-498e-902d-36ca8ef2c433 for instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b on hv-cinder-86160 Oct 17 17:56:56.623251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] Creating event network-vif-plugged:7b80a0c2-2a89-4a4b-ace3-0289c5a2c037 for instance 0ab22d3f-2eb8-4622-811d-504c4946430f on hv-cinder-86160 Oct 17 17:56:56.629170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:56.630243 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-838c0e75-77d8-4657-9fa3-79410b47751f req-632eb48d-dbe1-4d5d-9dd6-69a4d28cbc9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040375 Oct 17 17:56:56.631009 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 60/124] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:56:56.639687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:56.641623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:56.642765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-93243fdd-2ac0-408c-8f8a-066922b31ced tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.169293 Oct 17 17:56:56.643333 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 65/125] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:56 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:56.793069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:56.793767 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:56.800061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.800617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.801058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.802232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:56.802693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:56.803116 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:56.966276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:56.974090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-60c63817-f49e-40f9-8d06-a1056ceb1d4b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.185183 Oct 17 17:56:56.974743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 61/126] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:56 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:57.238149 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:57.238648 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:57.245229 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:57.245710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:57.246139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:57.246984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:57.247382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:57.247802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:57.391710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:57.400197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-feae4f26-8f41-4a85-bd7e-f0ca3ff0a888 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.165809 Oct 17 17:56:57.400930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 66/127] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:57 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:57.531687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:57.532384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:57.540625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:57.541323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:57.541851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:57.542621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:57.543139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:57.543776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:57.668792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:57.669575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:57.677096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:57.677918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:57.678446 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:57.679260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:57.679980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:57.680521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:57.736521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:57.745586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d6d68ff0-e43c-4597-b176-ea6be404484f tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.217948 Oct 17 17:56:57.746165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 62/128] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:57 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:57.847541 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:57.857306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:57.859426 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:57.860740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-01bece60-836a-4fc3-83ec-c83772b316aa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.196299 Oct 17 17:56:57.861442 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 67/129] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:57 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:56:57.998083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:57.998680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:58.005055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.005652 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.006080 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.006762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.007209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.007627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.179193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:58.184481 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ebb9148b-fba1-4579-a42d-3b8100cdde61 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.190042 Oct 17 17:56:58.185044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 63/130] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:57 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:58.424804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:58.425617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:58.432193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.432717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.433315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.434026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.434478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.434899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.579218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:58.587975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-adef18fb-accb-4ce9-bbe6-94ad0c6da183 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.168405 Oct 17 17:56:58.588705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 68/131] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:58 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:58.768845 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:58.769450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:58.775376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.775828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.776309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.777008 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.777451 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.779129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.893301 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:58.894617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:58.902399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.903398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.904362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.905420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:58.906093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:58.906822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:58.919734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:58.929656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-91eff830-cdc6-4620-8e14-6e20f5615fa6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.164628 Oct 17 17:56:58.930339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 64/132] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:58 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:59.058173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:59.066378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:59.068170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:59.069411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d5b15ee9-21bf-40fe-a6dd-0b275074bb34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.181167 Oct 17 17:56:59.069981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 69/133] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:56:58 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:56:59.207297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:59.208391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:59.214575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:59.215045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:59.215470 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:59.216183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:59.216649 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:59.217062 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:59.372444 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:59.381384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7a69b2fc-c3ea-4cbb-b9f5-0a82bb46183f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.177737 Oct 17 17:56:59.383083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 65/134] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:59 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:59.611474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:59.612642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:59.619558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:59.619850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:59.620298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:59.621018 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:59.621511 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:59.621986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:59.794953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:56:59.804035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-313b0afd-b688-441d-928a-d080bced124b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.196496 Oct 17 17:56:59.804755 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 70/135] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:59 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:56:59.952846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:56:59.954127 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:56:59.961071 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:59.961591 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:59.962019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:56:59.962710 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:56:59.963158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:56:59.963575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.099418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:00.100689 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:00.109603 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:00.109863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:00.110354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:00.110968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.111667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:00.112271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:00.112726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.121051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5da844c9-f9ca-4adc-8b70-c24557e6e8a7 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.171936 Oct 17 17:57:00.121644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:56:59 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:00.258883 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:00.266868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:00.268437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:00.269521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ef2c36b3-831b-498b-ae01-070702a0e759 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.175335 Oct 17 17:57:00.270082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 71/137] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:00 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:57:00.404674 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:00.405287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:00.414397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:00.414397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:00.414397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.414397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:00.417081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:00.417708 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.565728 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:00.573119 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6aa0a048-32f1-410a-9be9-3d2f12c806d6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.172194 Oct 17 17:57:00.573715 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 67/138] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:00 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:00.827077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:00.827781 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:00.834461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:00.834941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:00.835385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.836051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:00.836501 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:00.836947 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:00.974315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:00.984197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-07fa58b2-55f3-40eb-9698-5130631432ce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.160994 Oct 17 17:57:00.985004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 72/139] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:00 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:01.146673 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:01.147367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:01.153623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:01.158445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:01.158445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:01.158445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:01.158445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:01.159019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:01.290369 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:01.295936 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:01.296581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:01.300526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-89da6e75-d3cc-4db5-811f-a2ce86cd332e tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.158421 Oct 17 17:57:01.301843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 68/140] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:01 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:01.305667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:01.306305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:01.306745 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:01.307637 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:01.308107 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:01.308926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:01.596134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:01.596867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:01.604999 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:01.605907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:01.606691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:01.607517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:01.608310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:01.608965 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:01.670784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:01.681565 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:01.683666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:01.685136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a9124783-1b78-4193-91e2-8c6225059b85 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.393760 Oct 17 17:57:01.686209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 73/141] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:01 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:57:01.769890 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:01.778109 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-84074293-8bc6-48a0-9f54-1dd330282beb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.186476 Oct 17 17:57:01.778879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 69/142] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:01 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:02.008306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:02.008944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:02.014907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.015386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.015817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.016496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.016975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.017396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.147240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:02.154990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-33d7ebc6-4678-4c48-8b98-a2b11ab4f18d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.151114 Oct 17 17:57:02.155560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 74/143] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:02 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:02.325208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:02.325902 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:02.331823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.332394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.333004 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.333749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.334269 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.334764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.477460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:02.491102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-edc0d062-920e-4371-82df-49e14a1cf878 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.169567 Oct 17 17:57:02.491997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 70/144] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:02 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:02.711121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:02.711739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:02.717826 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.718300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.718729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.719439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.719952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.720372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.741025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:02.801512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:02.802435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:02.807605 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:02.809512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.809990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.810424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.811095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:02.811540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:02.811952 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:02.870429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:02.886002 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:02.887455 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:02.888657 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-74180d57-01f9-4af7-8313-b42cfffdcc34 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.181636 Oct 17 17:57:02.889537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 75/145] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:02 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:57:02.964619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:02.972102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-094b0f2d-71ba-47a1-a9cd-51f65310aafd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.174776 Oct 17 17:57:02.972677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 71/146] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:02 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:03.177722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:03.178548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:03.184687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:03.185178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:03.185610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:03.186297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:03.186751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:03.187173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:03.320242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:03.327855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d8aa5e36-4a3d-4d23-a3f8-ba67fb1c9dd2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1321 microversion: 2.1 time: 0.154381 Oct 17 17:57:03.328423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 76/147] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:03 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:03.515216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:03.515930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:03.522337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:03.522934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:03.523472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:03.524310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:03.524900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:03.525427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:03.685336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:03.696191 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c3bf3cf4-2de9-4a6d-a917-e956ff4ddd83 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.185006 Oct 17 17:57:03.709707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 72/148] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:03 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:03.913816 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:03.914420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:03.920297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:03.920848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:03.921286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:03.921981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:03.922426 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:03.922847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.001265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:04.002029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:04.009169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.010004 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.010449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.011168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.011617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.012031 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.069751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:04.078244 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:04.079674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:04.080805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e228d42d-28cf-41ba-ae3e-706b517eb973 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.171412 Oct 17 17:57:04.082398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 77/149] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:03 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:57:04.152077 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:04.160022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4588ff74-953e-43dc-a692-cbc7712365e4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.162549 Oct 17 17:57:04.160937 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 73/150] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:03 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:04.351286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:04.352057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:04.358124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.358605 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.359037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.359760 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.360157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.360636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.511851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-09a71109-4f8c-4387-893c-d80244ad15d7 req-2b6b6b3f-c960-4b2f-b57f-775f2d810c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4103da-d0cb-4d9c-b475-e0ee08b57398", "name": "network-vif-plugged", "status": "completed", "tag": "6f031636-bf67-4c5d-9a2a-708b298712ca"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:04.520780 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-09a71109-4f8c-4387-893c-d80244ad15d7 req-2b6b6b3f-c960-4b2f-b57f-775f2d810c57 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.521452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-09a71109-4f8c-4387-893c-d80244ad15d7 req-2b6b6b3f-c960-4b2f-b57f-775f2d810c57 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.522043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-09a71109-4f8c-4387-893c-d80244ad15d7 req-2b6b6b3f-c960-4b2f-b57f-775f2d810c57 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.538115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-09a71109-4f8c-4387-893c-d80244ad15d7 req-2b6b6b3f-c960-4b2f-b57f-775f2d810c57 service nova] Creating event network-vif-plugged:6f031636-bf67-4c5d-9a2a-708b298712ca for instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 on hv-cinder-86160 Oct 17 17:57:04.544406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-09a71109-4f8c-4387-893c-d80244ad15d7 req-2b6b6b3f-c960-4b2f-b57f-775f2d810c57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042404 Oct 17 17:57:04.547194 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 74/151] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:57:04.555018 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:04.563496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3c8a561b-04bc-435c-80b3-93759ae632a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1516 microversion: 2.1 time: 0.216347 Oct 17 17:57:04.577488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 78/152] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:04 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:04.589045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:04.591438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:04.597640 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.603295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.603295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.603295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.603295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.603689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.632827 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:04.669278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'flavor' on Instance uuid 46d9533e-9953-4305-87cb-374cd49a00fc {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:57:04.720854 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:04.721587 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:04.728712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.729280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.729744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.730436 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:04.730886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:04.731439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:04.897744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:04.905973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-50491e9f-ec2d-4860-97e2-d69e3f64a58c tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.189144 Oct 17 17:57:04.906542 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 79/153] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:04 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:05.015295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9d73167a-ed6f-43ae-9ddf-1da5ad374c31 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc/action" status: 200 len: 32 microversion: 2.1 time: 0.430806 Oct 17 17:57:05.015905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 75/154] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 17:57:04 2022] POST /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 17:57:05.026104 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:05.026711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:05.032705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.033055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.033486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.034174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.034622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.035033 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.107790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:05.108675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:05.115327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.115809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.116241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.116959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.117411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.117832 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.196647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:05.205143 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c341d4fd-dff0-4e00-8be9-9a91e196e75d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.182641 Oct 17 17:57:05.213579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 80/155] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:05 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:05.219738 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:05.221709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:05.228133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.228133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.228499 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.229237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.229734 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.230153 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.266206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:05.274992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:05.276483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:05.277653 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fefa9be6-6c83-450e-9cc7-956c606b18cc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.174114 Oct 17 17:57:05.278180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 76/156] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:05 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:57:05.379008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:05.387401 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e29abb2b-b8dd-443b-859f-936ad849fe95 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.172569 Oct 17 17:57:05.387997 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 81/157] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:05 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:05.930093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:05.930689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:05.936505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.937002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.937424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:05.938092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:05.938530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:05.938946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.068270 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:06.075731 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a8afe74c-9d89-45c2-ab6f-6f1499bd6e90 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.150141 Oct 17 17:57:06.076299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 77/158] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:05 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:06.239088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:06.239724 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:06.245766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.246247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.246679 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.247359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.247811 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.248229 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.305398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:06.306100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:06.312158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.313104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.313104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.313771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.314288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.314638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.407742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:06.416699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-41517058-ff31-4119-836c-bc898c85e3d9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.181336 Oct 17 17:57:06.417274 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 82/159] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:06 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:06.422133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:06.422727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:06.432400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.432400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.432400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.432400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.432715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.432715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.486962 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:06.495776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:06.497162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:06.498257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f1533cc8-10f4-4a60-8636-e47d738568b7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.196914 Oct 17 17:57:06.498805 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 78/160] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:06 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:57:06.559440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-6807e5e9-dd6f-4aa7-9231-7a74cab4b41c req-6579a04b-2a22-4d75-82ba-dab209ef8808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "name": "network-vif-plugged", "status": "completed", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:06.568947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-6807e5e9-dd6f-4aa7-9231-7a74cab4b41c req-6579a04b-2a22-4d75-82ba-dab209ef8808 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:06.569421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-6807e5e9-dd6f-4aa7-9231-7a74cab4b41c req-6579a04b-2a22-4d75-82ba-dab209ef8808 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:06.569839 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-6807e5e9-dd6f-4aa7-9231-7a74cab4b41c req-6579a04b-2a22-4d75-82ba-dab209ef8808 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:06.573305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:06.580492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-6807e5e9-dd6f-4aa7-9231-7a74cab4b41c req-6579a04b-2a22-4d75-82ba-dab209ef8808 service nova] Creating event network-vif-plugged:159ad1ae-f38b-4dca-afd5-a41b7031cb8c for instance d932b27f-b1fd-42b4-a8e3-3908063839da on hv-cinder-86160 Oct 17 17:57:06.581039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e177f395-1a9f-4afd-b735-72b07b8e1cc7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.162640 Oct 17 17:57:06.581615 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 83/161] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:06 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:06.586416 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-6807e5e9-dd6f-4aa7-9231-7a74cab4b41c req-6579a04b-2a22-4d75-82ba-dab209ef8808 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030514 Oct 17 17:57:06.586998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 79/162] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:57:07.099379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:07.100004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:07.106029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.106484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.106918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.107597 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.108051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.108471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.235986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:07.244214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d8ea69b6-3fc6-425e-8501-825ffa18e6a8 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.148881 Oct 17 17:57:07.244811 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 84/163] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:07 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:07.440311 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:07.441022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:07.447806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.448368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.448842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.449465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.449940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.450357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.522315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:07.523041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:07.529025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.534283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.534283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.534283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.534283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.534808 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.631265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:07.639165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9354e897-2b7c-424c-b454-8bf3234d0126 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.203089 Oct 17 17:57:07.639780 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 80/164] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:07 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:07.644174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:07.644822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:07.650724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.651215 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.651624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.652312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:07.652782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:07.653384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:07.679581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:07.687674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:07.689150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:07.690250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7aca7786-aa6b-4b63-ae19-ad487452e8d8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.172151 Oct 17 17:57:07.690901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 85/165] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:07 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:57:07.783463 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:07.792067 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7c7a9690-6861-419c-9ebd-39bd5e09014f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.151320 Oct 17 17:57:07.792715 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 81/166] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:07 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:08.267449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:08.267982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:08.276098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.276584 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.277047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.277744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.278622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.278622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.418749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:08.427655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b8e50167-3235-4398-945b-148473694808 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1315 microversion: 2.1 time: 0.163687 Oct 17 17:57:08.428955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 86/167] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:08 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:08.665949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:08.666732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:08.672575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.673279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.673711 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.674586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.675472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.676078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.715199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:08.715825 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:08.721766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.722249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.722682 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.723373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.723932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.724730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.880842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:08.903969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d7411742-ff52-415d-94f4-8a4b629c04fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.244973 Oct 17 17:57:08.906564 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 82/168] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:08 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:08.917843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:08.920256 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:08.934349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.935076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.935384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:08.935995 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.936930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:08.937582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:08.938203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:08.946105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:08.948580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:08.950637 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-20415ea5-0d57-4b06-81f7-5455528c855a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.238515 Oct 17 17:57:08.952108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 87/169] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:08 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:57:09.100447 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:09.108262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-01bbb2d5-5bd0-4d4c-8042-596baefd552d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.200605 Oct 17 17:57:09.108866 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 83/170] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:08 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:09.451359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:09.452060 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:09.458524 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:09.458869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:09.459507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:09.460193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:09.460672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:09.461096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:09.674384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:09.682890 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f6c45e99-2f2e-43b6-9ae6-176136fbd3ac tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1502 microversion: 2.1 time: 0.235524 Oct 17 17:57:09.683500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 88/171] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:09 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:09.930148 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:09.930755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:09.936665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:09.937128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:09.937558 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:09.938242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:09.943694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:09.943694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:09.980863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:09.981557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:09.989294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:09.991349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:09.991958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:09.992935 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:09.993520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:09.994130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:10.128673 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:10.137217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-123d5043-e6cd-4465-8a57-60fccff137b0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.210896 Oct 17 17:57:10.137805 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 84/172] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:09 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:10.142302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:10.143068 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:10.149606 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:10.150272 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:10.150710 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:10.151393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:10.151984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:10.152535 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:10.287162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:10.295294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:10.298967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:10.300793 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-dc73db80-f36e-47d0-9405-1d20d99f2f3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1407 microversion: 2.20 time: 0.324006 Oct 17 17:57:10.302523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 89/173] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:09 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:57:10.395928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:10.422619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b21d0d0c-3c4f-4734-b5a7-b104922b3048 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.283738 Oct 17 17:57:10.437189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 85/174] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:10 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:11.162472 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:11.163097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:11.169074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.169546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.170032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.170727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.171172 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.171585 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.305015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:11.312674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-868ccdd2-b32d-45e8-a351-0cf16f6f4b39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.154870 Oct 17 17:57:11.313244 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 90/175] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:11 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:11.335304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:11.335715 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:11.341865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.342335 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.342759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.343442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.343884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.344336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.453414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:11.456816 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:11.467193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.467684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.468117 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.468988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.469439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.469878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.497691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:11.510730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:11.512373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:11.513669 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3f53cc77-4021-4990-b36a-4073d4383e1d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1600 microversion: 2.20 time: 0.183873 Oct 17 17:57:11.514812 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 86/176] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:57:11 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:57:11.560824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:11.562054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:11.587520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.588015 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.588552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.589261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:11.594535 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:11.597450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:11.715232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:11.726402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7c258e9d-6087-4d9c-b9a9-7776c735c89d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.276350 Oct 17 17:57:11.726661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-11f3caeb-4286-467c-8d80-1dfee1dddc97 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.177387 Oct 17 17:57:11.727578 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 87/177] 10.222.0.58 () {60 vars in 1316 bytes} [Mon Oct 17 17:57:11 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 17:57:11.732734 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 91/178] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:11 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:12.340444 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:12.342353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:12.352989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:12.353891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:12.354521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:12.356028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:12.356692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:12.357411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:12.728069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e4d7419-4526-4498-b2ca-65dd634969bb"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:12.740524 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:12.754222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:12.754762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:12.758342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:12.760896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:12.761389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:12.761880 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:12.778291 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:12.791277 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-014717fb-7d59-41a0-b55c-51435043f7a9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.454297 Oct 17 17:57:12.791950 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 88/179] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:12 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:12.798808 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:12.802455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:12.803575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:12.817006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:12.817772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:12.819348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:12.820970 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:12.822771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:12.823200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:13.111305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:13.121422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c6f86cc7-a91c-443a-a4fb-308d3f9d7b1f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.328104 Oct 17 17:57:13.122222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 89/180] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:12 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:13.478309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-f57c8e6a-9d51-4c77-806a-a13cbce98086 req-6034a418-a0d5-4b94-a58a-4f1ca56d16b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:13.499192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f57c8e6a-9d51-4c77-806a-a13cbce98086 req-6034a418-a0d5-4b94-a58a-4f1ca56d16b0 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:13.499686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f57c8e6a-9d51-4c77-806a-a13cbce98086 req-6034a418-a0d5-4b94-a58a-4f1ca56d16b0 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:13.500479 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f57c8e6a-9d51-4c77-806a-a13cbce98086 req-6034a418-a0d5-4b94-a58a-4f1ca56d16b0 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:13.524933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-f57c8e6a-9d51-4c77-806a-a13cbce98086 req-6034a418-a0d5-4b94-a58a-4f1ca56d16b0 service nova] Creating event network-changed:159ad1ae-f38b-4dca-afd5-a41b7031cb8c for instance d932b27f-b1fd-42b4-a8e3-3908063839da on hv-cinder-86160 Oct 17 17:57:13.530351 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-f57c8e6a-9d51-4c77-806a-a13cbce98086 req-6034a418-a0d5-4b94-a58a-4f1ca56d16b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056810 Oct 17 17:57:13.530937 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 90/181] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:57:13.821268 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:13.822257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:13.829627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:13.830110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:13.830539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:13.831398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:13.831850 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:13.832268 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:13.847825 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:13.990731 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:13.999444 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c72fc44b-06b1-4898-90ce-01431601cca0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.183384 Oct 17 17:57:14.000015 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 91/182] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:13 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:14.144844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:14.146068 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:14.155891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:14.156444 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:14.156961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:14.157861 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:14.158645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:14.159232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:14.306405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:14.314843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3dbd8835-8543-48d0-aa8a-2776f9c3378b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1367 microversion: 2.1 time: 0.173862 Oct 17 17:57:14.315596 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 92/183] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:14 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:15.023664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:15.024685 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:15.066135 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:15.071011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:15.071557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:15.073175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:15.073977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:15.075814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:15.325894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:15.333696 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b1b7c24c-70a6-417e-88fe-80f3ff4ff876 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.314995 Oct 17 17:57:15.334278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 93/184] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:15 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:15.340329 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:15.341167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:15.349739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:15.350345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:15.350669 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:15.351373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:15.351830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:15.352280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:15.493651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:15.501278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-237e24f2-2fe6-4b90-8979-9f90596daf4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1558 microversion: 2.1 time: 0.165368 Oct 17 17:57:15.502064 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 94/185] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:15 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:15.525712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:15.526207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:15.542757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:15.543885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:15.544495 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:15.545259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:15.546465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:15.547048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:15.640006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3af873c5-7cdc-43f3-90b5-a3e61976d922 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118111 Oct 17 17:57:15.640774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 95/186] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 17:57:15 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:57:16.358499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:16.368907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:16.380934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:16.381796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:16.382262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:16.385234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:16.385758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:16.388858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:16.416968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-85017114-f142-4678-8e6b-7a999a42dc10 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "POST /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.699131 Oct 17 17:57:16.417827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 92/187] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 17:57:12 2022] POST /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f/os-volume_attachments => generated 194 bytes in 3701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:57:16.808161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:16.808161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f62d4fa8-45ef-4147-9f93-0561797e5882 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.453953 Oct 17 17:57:16.808161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 96/188] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:16 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:17.836556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:17.838968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:17.848005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=96 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:17.850933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:17.851418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:17.851927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:17.852688 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:17.853147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:17.853579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:17.995793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-7e081548-6f98-445b-9786-dad517f3d2cc req-f34c1958-e556-48fe-85b8-db0de22c82ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4103da-d0cb-4d9c-b475-e0ee08b57398", "tag": "6f031636-bf67-4c5d-9a2a-708b298712ca"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:18.008497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7e081548-6f98-445b-9786-dad517f3d2cc req-f34c1958-e556-48fe-85b8-db0de22c82ea service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:18.011418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7e081548-6f98-445b-9786-dad517f3d2cc req-f34c1958-e556-48fe-85b8-db0de22c82ea service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:18.011877 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-7e081548-6f98-445b-9786-dad517f3d2cc req-f34c1958-e556-48fe-85b8-db0de22c82ea service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:18.041825 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-7e081548-6f98-445b-9786-dad517f3d2cc req-f34c1958-e556-48fe-85b8-db0de22c82ea service nova] Creating event network-changed:6f031636-bf67-4c5d-9a2a-708b298712ca for instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 on hv-cinder-86160 Oct 17 17:57:18.047296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-7e081548-6f98-445b-9786-dad517f3d2cc req-f34c1958-e556-48fe-85b8-db0de22c82ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055670 Oct 17 17:57:18.048438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 97/189] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:57:18.073349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:18.084326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ce206e31-e6e6-47c9-8337-4b5d4e7ae4e6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.252191 Oct 17 17:57:18.089413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 93/190] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:17 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:19.114208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:19.115760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:19.124427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:19.124939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:19.125542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:19.126235 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:19.126687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:19.127105 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:19.267543 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:19.276483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-135e9358-d8d6-4831-a9dd-071ae4db5b68 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.166590 Oct 17 17:57:19.277083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 98/191] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:19 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:20.299567 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:20.300126 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:20.307435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:20.307911 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:20.308343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:20.309054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:20.309691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:20.310120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:20.442081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:20.450081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a6f7ef5a-754a-4f23-9cb2-1687f98c490c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.154426 Oct 17 17:57:20.450651 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 94/192] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:20 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:21.473428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:21.474097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:21.480865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:21.481363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:21.481790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:21.482471 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:21.482917 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:21.483331 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:21.621334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:21.630358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fe5b7db5-c27a-43b8-a029-210ac7917704 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.160637 Oct 17 17:57:21.631030 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 99/193] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:21 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:22.653166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:22.657456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:22.664705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:22.665076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:22.665974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:22.667414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:22.667877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:22.668304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:22.929062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:22.939391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0a90698c-b672-42af-87f2-e97e1eb695ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.290172 Oct 17 17:57:22.939980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 95/194] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:22 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:23.963786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:23.964437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:23.970410 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:23.971598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:23.971598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:23.972734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:23.973183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:23.973606 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:24.252111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:24.252111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:24.260233 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:24.260895 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:24.261705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:24.263625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:24.264863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:24.265729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:24.342649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 17:57:24.387045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:24.396440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-244e6947-abcf-460a-9b0d-1c6918311d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.436437 Oct 17 17:57:24.397293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 100/195] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:23 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:24.672073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0f44d66c-6b00-4e4f-b487-9a96c73a57f2 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 204 len: 0 microversion: 2.1 time: 0.427624 Oct 17 17:57:24.673858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 96/196] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 17:57:24 2022] DELETE /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 17:57:24.686158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:24.686776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:24.693188 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:24.693680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:24.694476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:24.695299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:24.695755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:24.696174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:24.885179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:24.893209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d3aadd9f-7d72-4b4a-aeb9-73514bde0cfe tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1554 microversion: 2.1 time: 0.211323 Oct 17 17:57:24.893778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 101/197] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:24 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:25.419903 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:25.422092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:25.428191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:25.428694 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:25.429127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:25.429818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:25.430269 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:25.430711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:25.573994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:25.582635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-53241fdc-b3a2-4f9b-9991-10bcd19337db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.166955 Oct 17 17:57:25.589744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 97/198] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:25 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:25.920551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:25.921727 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:25.930561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:25.931309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:25.931947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:25.932745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:25.933408 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:25.933903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:26.117218 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:26.125341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-15206ec4-32e6-4ec6-a85d-bbdb614465d9 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1554 microversion: 2.1 time: 0.210142 Oct 17 17:57:26.125981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 102/199] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:25 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:26.609764 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:26.610904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:26.622888 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:26.623654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:26.624238 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:26.627818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:26.627818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:26.627818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:26.774090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:26.782286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-badaaeb2-b0d9-42df-a50b-e86453dea752 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.179642 Oct 17 17:57:26.782933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 98/200] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:26 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:27.150460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:27.151456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:27.159108 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:27.159647 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:27.160084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:27.164904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:27.164904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:27.164904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:27.305574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:27.314134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c6e8dc01-ebfb-4bb7-88f2-9ef4b14ee7ef tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1554 microversion: 2.1 time: 0.169182 Oct 17 17:57:27.314762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 103/201] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:27 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:27.809907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:27.810557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:27.819298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:27.819425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:27.819857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:27.820841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:27.821420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:27.822068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:27.986718 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:27.996950 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bbe91749-003c-4c43-ad0b-5c1cc2c3ac0c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.190662 Oct 17 17:57:27.997908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 99/202] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:27 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:28.338894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:28.340329 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:28.350905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:28.351406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:28.351860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:28.352568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:28.367391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:28.367391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:28.457478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-b6594838-2193-4908-ab43-c7f6904aff68 req-e9a96876-f628-4854-a472-56199d98e05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab22d3f-2eb8-4622-811d-504c4946430f", "name": "network-vif-deleted", "tag": "7b80a0c2-2a89-4a4b-ace3-0289c5a2c037"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:28.468877 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:28.471730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b6594838-2193-4908-ab43-c7f6904aff68 req-e9a96876-f628-4854-a472-56199d98e05c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:28.474165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b6594838-2193-4908-ab43-c7f6904aff68 req-e9a96876-f628-4854-a472-56199d98e05c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:28.474165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b6594838-2193-4908-ab43-c7f6904aff68 req-e9a96876-f628-4854-a472-56199d98e05c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:28.478757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-01ace83d-8feb-4da8-9925-57dc5b04dfb0 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1512 microversion: 2.1 time: 0.143635 Oct 17 17:57:28.479350 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 104/203] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:28 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1512 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:28.490998 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-b6594838-2193-4908-ab43-c7f6904aff68 req-e9a96876-f628-4854-a472-56199d98e05c service nova] Creating event network-vif-deleted:7b80a0c2-2a89-4a4b-ace3-0289c5a2c037 for instance 0ab22d3f-2eb8-4622-811d-504c4946430f on hv-cinder-86160 Oct 17 17:57:28.498074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-b6594838-2193-4908-ab43-c7f6904aff68 req-e9a96876-f628-4854-a472-56199d98e05c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043960 Oct 17 17:57:28.506669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 100/204] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:57:29.020367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:29.021130 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:29.029553 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:29.030040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:29.030614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:29.031342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:29.031936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:29.032365 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:29.190585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:29.203342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fa1e24a4-b9cc-42ea-ad4a-db6045384cb2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.187519 Oct 17 17:57:29.204915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 105/205] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:29 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:29.503490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:29.504324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:29.510680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:29.511164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:29.511763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:29.512464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:29.513097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:29.513518 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:29.551960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:29.552457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:29.553600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:29.554063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lazy-loading 'fault' on Instance uuid 0ab22d3f-2eb8-4622-811d-504c4946430f {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:57:29.612554 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22168d7fce44adbbe055c2f1e0dcf1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbc86a8dc5a437ba59bd4ce6686d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:29.621927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9570fbbb-d298-4db5-973e-6958652c4d31 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 200 len: 1351 microversion: 2.1 time: 0.122838 Oct 17 17:57:29.622469 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 101/206] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:29 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:30.230307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:30.231686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:30.238679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:30.239274 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:30.239767 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:30.241209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:30.242044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:30.242612 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:30.419184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:30.427132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-929ff65a-5b3f-4ec8-82ac-80438f032d53 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.201180 Oct 17 17:57:30.431043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 106/207] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:30 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:30.650439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:30.651151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:30.659388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:30.659388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:30.659388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:30.659781 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:30.660236 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:30.660692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:30.674739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] HTTP exception thrown: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Request method failure captured: Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f HTTP/1.1 Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdDb7AMSE-yNwhT9Zl3_JMtXdpK-TNAhKwUg53aZ7Q_uTGChgrz6CgB9_6cwY8JDSqnYRh8tcB2mifmDd--fFugkvyYVgYAeKePoJpSXt6RXDBta_TX5rkHP5ETePChevW81WOoGF81hASZK5WX8VaddlTk2Mbvnf51yFq9GUrAn0k Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:57:30.679898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dbc86a8dc5a437ba59bd4ce6686d326", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}] Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: e22168d7fce44adbbe055c2f1e0dcf1b Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.683165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '0ab22d3f-2eb8-4622-811d-504c4946430f'} Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:57:30.684070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.685495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.686772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Returning 404 to user: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:57:30.686772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-da707496-60c6-4ef1-ab85-5a7d9ccbc2b6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 404 len: 111 microversion: 2.1 time: 0.035313 Oct 17 17:57:30.686772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 102/208] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:30 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:57:30.804344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:30.806773 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:30.812981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:30.815180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:30.815865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:30.816301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:30.816787 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:30.817394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:30.836488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] HTTP exception thrown: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Request method failure captured: Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f/os-volume_attachments HTTP/1.1 Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdDb7AMSE-yNwhT9Zl3_JMtXdpK-TNAhKwUg53aZ7Q_uTGChgrz6CgB9_6cwY8JDSqnYRh8tcB2mifmDd--fFugkvyYVgYAeKePoJpSXt6RXDBta_TX5rkHP5ETePChevW81WOoGF81hASZK5WX8VaddlTk2Mbvnf51yFq9GUrAn0k Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 17:57:30.849355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dbc86a8dc5a437ba59bd4ce6686d326", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}] Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: e22168d7fce44adbbe055c2f1e0dcf1b Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.855525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'server_id': '0ab22d3f-2eb8-4622-811d-504c4946430f'} Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:57:30.856182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:30.857746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:30.859713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Returning 404 to user: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:57:30.859713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-863bce9e-b07e-456a-8461-bf4a20032dbc tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052439 Oct 17 17:57:30.859713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 107/209] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 17:57:30 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:57:31.450792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:31.451484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:31.457583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:31.458058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:31.458490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:31.459342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:31.459966 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:31.460393 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:31.595391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:31.606112 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0a5c6097-69f2-4396-ade0-690fb5deac39 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.158305 Oct 17 17:57:31.607020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 103/210] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:31 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:32.633671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:32.633671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:32.640867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:32.641541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:32.645396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:32.645396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:32.645396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:32.645396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:32.808443 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:32.821199 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-88c3356a-19b1-4477-b1dc-cef271802d38 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.189786 Oct 17 17:57:32.823401 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 108/211] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:32 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:33.845536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:33.846148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:33.854083 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:33.854566 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:33.854994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:33.855685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:33.856129 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:33.856552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:34.016046 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:34.037803 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5309fb1a-e358-46d3-982a-f4dac96b527e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.183389 Oct 17 17:57:34.038320 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 104/212] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:33 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:34.993232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:34.995876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:34.995876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=75 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:35.000301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:35.000834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:35.001252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:35.001966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:35.002419 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:35.002812 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:35.017827 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] HTTP exception thrown: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Request method failure captured: Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f HTTP/1.1 Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdDb7AMSE-yNwhT9Zl3_JMtXdpK-TNAhKwUg53aZ7Q_uTGChgrz6CgB9_6cwY8JDSqnYRh8tcB2mifmDd--fFugkvyYVgYAeKePoJpSXt6RXDBta_TX5rkHP5ETePChevW81WOoGF81hASZK5WX8VaddlTk2Mbvnf51yFq9GUrAn0k Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 17:57:35.020095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dbc86a8dc5a437ba59bd4ce6686d326", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}] Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: e22168d7fce44adbbe055c2f1e0dcf1b Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.024262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '0ab22d3f-2eb8-4622-811d-504c4946430f'} Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:57:35.025097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.026196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.027573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Returning 404 to user: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:57:35.027573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3213c9ef-5362-453b-9ff7-83a69f4ea5d6 tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 404 len: 111 microversion: 2.1 time: 0.033879 Oct 17 17:57:35.027573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 109/213] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 17:57:34 2022] DELETE /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:57:35.046790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:35.046790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] [instance: 0ab22d3f-2eb8-4622-811d-504c4946430f] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:35.053342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:35.054388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:35.054806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:35.055156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:35.055534 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:35.056203 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:35.056849 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:35.057585 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:35.062170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:35.062671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:35.063111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:35.063835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:35.064288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:35.064869 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:35.078294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] HTTP exception thrown: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Request method failure captured: Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f HTTP/1.1 Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdDb7AMSE-yNwhT9Zl3_JMtXdpK-TNAhKwUg53aZ7Q_uTGChgrz6CgB9_6cwY8JDSqnYRh8tcB2mifmDd--fFugkvyYVgYAeKePoJpSXt6RXDBta_TX5rkHP5ETePChevW81WOoGF81hASZK5WX8VaddlTk2Mbvnf51yFq9GUrAn0k Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:57:35.080201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5dbc86a8dc5a437ba59bd4ce6686d326", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5dbc86a8dc5a437ba59bd4ce6686d326"}]}] Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 5dbc86a8dc5a437ba59bd4ce6686d326 Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-DeleteServersTestJSON-1824011718 Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: e22168d7fce44adbbe055c2f1e0dcf1b Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-DeleteServersTestJSON-1824011718-project Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.081622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '0ab22d3f-2eb8-4622-811d-504c4946430f'} Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:57:35.082284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. Oct 17 17:57:35.083696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:57:35.087183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] Returning 404 to user: Instance 0ab22d3f-2eb8-4622-811d-504c4946430f could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:57:35.088028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:35.088272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5f01ef88-1265-4c7d-b8ff-277978d424fd tempest-DeleteServersTestJSON-1824011718 tempest-DeleteServersTestJSON-1824011718-project] 10.222.0.58 "GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f" status: 404 len: 111 microversion: 2.1 time: 0.041590 Oct 17 17:57:35.088272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 105/214] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:35 2022] GET /compute/v2.1/servers/0ab22d3f-2eb8-4622-811d-504c4946430f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:57:35.343936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:35.351989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e1550e4f-ef26-4712-a1f5-cdfa30335549 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.301965 Oct 17 17:57:35.352557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 110/215] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:35 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:36.375742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:36.376452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:36.387622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:36.388297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:36.388879 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:36.389834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:36.390419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:36.390958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:36.652933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:36.660722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f1e9451d-816b-438a-a86f-2b42af47c861 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.289464 Oct 17 17:57:36.661283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 106/216] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:36 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:37.685833 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:37.686442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:37.696497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:37.697022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:37.697464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:37.698172 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:37.698628 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:37.699092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:38.007838 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:38.015742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0c829cbf-e607-43b7-bcea-c972315c963e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.334157 Oct 17 17:57:38.016316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 111/217] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:37 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:39.040786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:39.041880 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:39.052968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:39.053903 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:39.054349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:39.055061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:39.055532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:39.055951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:39.077338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:39.278974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:39.296703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3eb0ffbb-d443-4e05-afc7-1f233e104ce1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1522 microversion: 2.1 time: 0.261057 Oct 17 17:57:39.297493 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 107/218] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:39 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:57:40.323632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:40.324278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:40.338530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:40.339023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:40.339450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:40.340147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:40.340619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:40.341019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:40.534110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:40.542440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-443fc6aa-3965-4092-926e-81fb837e41c3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1502 microversion: 2.1 time: 0.225054 Oct 17 17:57:40.551313 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 112/219] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:40 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:40.574240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:40.577145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:40.582956 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:40.583970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:40.586026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:40.587401 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:40.587894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:40.588688 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:40.740886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:40.749802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-818620cc-e2a6-47b5-97fb-b96bd2cc6cc2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1515 microversion: 2.1 time: 0.179247 Oct 17 17:57:40.762270 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 108/220] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:40 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:44.810911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:44.816333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:44.820049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:44.820573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:44.821222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:44.821918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:44.822367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:44.822777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:44.846947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'flavor' on Instance uuid ba64c9aa-8ed7-4020-8fcb-90e39eab659b {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:57:45.120854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-527608d4-d6f2-4c3c-9aff-a7279dd0fff8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/action" status: 200 len: 32 microversion: 2.1 time: 0.310132 Oct 17 17:57:45.120854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 113/221] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 17:57:44 2022] POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 17:57:45.129255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:45.129899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:45.137927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:45.138414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:45.139019 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:45.139760 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:45.140160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:45.140576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:45.293610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:45.306548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-06beacd4-fb12-4c8e-9f57-cb45cc369a57 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.181550 Oct 17 17:57:45.307420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 109/222] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:45 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:46.330698 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:46.331487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:46.337760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:46.338333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:46.338772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:46.339464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:46.339915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:46.340336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:46.471424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:46.479814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-daa8988f-ea8d-48ae-ab97-e9360405b79a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.153394 Oct 17 17:57:46.480385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 114/223] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:46 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:47.502508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:47.503112 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:47.510349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:47.510820 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:47.511249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:47.511926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:47.512370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:47.512858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:47.645491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:47.653770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2fdb7391-885b-43ca-bff7-d9cea900cd0e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.155159 Oct 17 17:57:47.654422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 110/224] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:47 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:48.678616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:48.679515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:48.686207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:48.686730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:48.687202 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:48.687975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:48.688491 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:48.688979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:48.828103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:48.837825 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d9543c88-c430-4676-9b63-050c992ef7ca tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.164206 Oct 17 17:57:48.838403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 115/225] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:48 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:49.861638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:49.862264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:49.864559 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:57:49.870383 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:49.870904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:49.871339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:49.872070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:49.872524 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:49.872986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:50.032912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:50.042072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-70a32bcf-7ec6-4a4e-b51a-274607cf243d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.184602 Oct 17 17:57:50.042584 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 111/226] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:49 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:51.067034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:51.068502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:51.082496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:51.082992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:51.083426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:51.086909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:51.088536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:51.090242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:51.320540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:51.328519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ade52992-96e6-48c7-9f5f-8ef32528d252 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.267152 Oct 17 17:57:51.329231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 116/227] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:51 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:52.352298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:52.352924 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:52.359602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:52.360078 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:52.360506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:52.361248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:52.366398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:52.366398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:52.542280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:52.556041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7e050b1f-0764-4322-a82a-56e562b6d3c0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.208492 Oct 17 17:57:52.557571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 112/228] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:52 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:53.581189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:53.581804 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:53.588758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:53.589375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:53.589682 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:53.590379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:53.590881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:53.591383 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:53.799431 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:53.808088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2d860a27-79a0-4be0-9ccf-4959ad697b75 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.230723 Oct 17 17:57:53.808680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 117/229] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:53 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:54.862327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:54.862327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:54.862327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:54.862327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:54.864170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:54.864170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:54.864170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:54.864170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:54.977158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:54.985218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-57bde390-db2b-421b-abe6-8d01845d7ad2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.158062 Oct 17 17:57:54.985786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 113/230] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:54 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:56.010267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:56.010875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:56.018396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:56.018880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:56.019475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:56.020197 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:56.020684 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:56.021108 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:56.154769 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:56.163432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-70cd07f9-6000-4532-9b5f-6725a64bd79d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.157195 Oct 17 17:57:56.164490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 118/231] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:56 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:57.188293 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:57.188989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:57.198013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:57.198725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:57.199367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:57.200076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:57.200508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:57.200954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:57.445325 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:57.454199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-604d6c7f-d01d-4b82-ace4-c80c289e7f20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.269769 Oct 17 17:57:57.455540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 114/232] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:57 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:57.487427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1905248632", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "networks": [{"uuid": "46eae69b-b33b-4b1c-8871-d27f67112bbd"}]}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:57:57.551972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] validate_networks() for [('46eae69b-b33b-4b1c-8871-d27f67112bbd', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:57:57.950254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:57:57.950813 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:57:57.951361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:57:57.951880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:57:57.952380 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:57:57.962027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:57.962507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:57.967049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:57.967049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:57.967049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:57.967049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:57.983082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Getting quotas for project a83fc47293e042d99a58560f5c847558. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:57:57.987724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Getting quotas for user c67de166f6bb4a66ae1b70335035a02c and project a83fc47293e042d99a58560f5c847558. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:57:58.000772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:57:58.003242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:57:58.106058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1d2af5b5-8b39-48e6-aa51-91930b02dbef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623768 Oct 17 17:57:58.107454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 119/233] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:57:58.123468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0dfb28b2-1b9e-4b69-bc26-b17c80626335 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:58.124385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0dfb28b2-1b9e-4b69-bc26-b17c80626335 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:58.194223 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-0dfb28b2-1b9e-4b69-bc26-b17c80626335 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:58.211263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0dfb28b2-1b9e-4b69-bc26-b17c80626335 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1219 microversion: 2.1 time: 0.096843 Oct 17 17:57:58.213192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 115/234] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:58 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:58.481509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:58.482257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:58.489393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:58.491139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:58.491785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:58.492831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:58.493526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:58.494177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:58.652743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:58.661572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1c8c0ba7-cdbe-4747-a949-6682cc4a3032 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.187335 Oct 17 17:57:58.671773 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 120/235] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:58 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:59.239271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e8c99d64-1b15-443d-b631-d9a0e9fedf80 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:59.239874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e8c99d64-1b15-443d-b631-d9a0e9fedf80 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:59.297547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e8c99d64-1b15-443d-b631-d9a0e9fedf80 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:59.305737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e8c99d64-1b15-443d-b631-d9a0e9fedf80 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1219 microversion: 2.1 time: 0.070256 Oct 17 17:57:59.306582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 116/236] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:59 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:57:59.685831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:57:59.686414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:57:59.708240 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:59.708865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:59.709904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:59.710611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:57:59.711992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:57:59.712416 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:57:59.891684 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:57:59.900753 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4ddd1e00-e830-41ae-9bed-5ad5e029c3b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.219278 Oct 17 17:57:59.901332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 121/237] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:57:59 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:00.331105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:00.331714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:00.338733 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:00.339212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:00.339645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:00.340326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:00.340827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:00.341249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:00.405859 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:00.414601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-dde41406-7f05-45a6-a5a7-6175f93312a6 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1223 microversion: 2.1 time: 0.087091 Oct 17 17:58:00.415177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 117/238] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:00 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:00.923497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:00.924049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:00.935345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:00.935828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:00.936252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:00.936971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:00.937419 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:00.939405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:01.097809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:01.106710 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b75f894e-49a4-4f0d-884f-b14e2da1e99b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.187208 Oct 17 17:58:01.108768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 122/239] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:00 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:01.440386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:01.441574 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:01.450687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:01.451168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:01.451652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:01.452529 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:01.453478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:01.453905 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:01.517912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:01.526367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-57c5a219-5b1c-425b-9419-78754bdeae0b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1271 microversion: 2.1 time: 0.090992 Oct 17 17:58:01.526950 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 118/240] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:01 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:02.130795 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:02.132555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:02.138674 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:02.139224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:02.139821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:02.140694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:02.141294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:02.141870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:02.276074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:02.283863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d8f3f46c-82a7-416e-82d4-710f70c29dce tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.156838 Oct 17 17:58:02.299270 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 123/241] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:02 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:02.549241 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:02.549847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:02.556754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:02.557232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:02.557659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:02.558344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:02.558794 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:02.559215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:02.622967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:02.630753 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f709fb6f-72c5-41bd-bd56-c6c8531a10db tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1271 microversion: 2.1 time: 0.085257 Oct 17 17:58:02.632358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 119/242] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:02 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:03.307812 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:03.308426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:03.314437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:03.319462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:03.319462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:03.319462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:03.319462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:03.319942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:03.464563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:03.472263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-21ef73d6-45e7-4fa5-b60e-7dbb20c0a092 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.168973 Oct 17 17:58:03.472865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 124/243] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:03 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:03.655562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:03.656178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:03.663176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:03.663662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:03.664106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:03.664965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:03.665421 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:03.665851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:03.758840 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:03.769134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-feff10a7-3f1b-4457-9b3c-39483821af18 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1271 microversion: 2.1 time: 0.117317 Oct 17 17:58:03.769717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 120/244] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:03 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:04.494526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:04.495208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:04.501413 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:04.501960 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:04.502453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:04.503332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:04.504027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:04.504457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:04.651646 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:04.653974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:04.660107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4c3b0761-9277-494b-b20f-5cc941b09de9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.169639 Oct 17 17:58:04.660704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 125/245] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:04 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:04.795323 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:04.796035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:04.807744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:04.808239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:04.808760 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:04.809471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:04.809991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:04.810411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:04.878770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:04.892621 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a94eeea7-e27a-42d1-b93f-4502dae2ff25 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1271 microversion: 2.1 time: 0.103577 Oct 17 17:58:04.893391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 121/246] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:04 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:05.035094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:05.035729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:05.043889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:05.044671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:05.046314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:05.046314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:05.046782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:05.047566 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:05.076464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5e0f710f-7335-4699-a5d7-079ceb998e5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/ips" status: 200 len: 151 microversion: 2.1 time: 0.045845 Oct 17 17:58:05.085403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 126/247] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 17:58:05 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:05.683427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:05.684067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:05.690829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:05.691199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:05.692058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:05.692981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:05.693441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:05.694425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:05.924940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:05.926118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:05.947087 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:05.952653 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:05.954894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:05.955971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:05.957852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:05.960051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:05.968505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.083121 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:06.088664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:06.091701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c6036283-ab59-4163-876e-e5e0683e8eef tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1279 microversion: 2.1 time: 0.179540 Oct 17 17:58:06.092713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 127/248] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:05 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:06.109423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0287a247-7ee3-48b5-9b35-eb854c146937 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1501 microversion: 2.1 time: 0.430086 Oct 17 17:58:06.110345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 122/249] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:05 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1501 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:06.137599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "882ffafc-33ef-43b3-9bf8-9352c832c10c"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:06.140014 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:06.145993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:06.147200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:06.147822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.148520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:06.149275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:06.149410 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.178965 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] HTTP exception thrown: Cannot 'attach_volume' instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b while it is in vm_state rescued Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Request method failure captured: Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/os-volume_attachments HTTP/1.1 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 74 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZc_LxtLnNF4-kOQ9U7p3o6IbidtToA8RcEcFI97Euc4n3M7A-xl1inD5QCE4jmsvUxd0homtc0JQXQtgUegBvwsJDFRhnk-4tfJjfLULjHqfHcNQ_tgPj1PVVrqB3-2GHjJEAZksdYwhTNriz4gzz1Rm-OfpyeTm8rPT_1Sd5nSiS0 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 17:58:06.181465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54dacea98b1448ab828595f9e1c31a13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}] Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: af69042a7ac34adb92bae0288e51aa76 Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {"volumeAttachment": {"volumeId": "882ffafc-33ef-43b3-9bf8-9352c832c10c"}} Oct 17 17:58:06.183051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Cannot 'attach_volume' instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b while it is in vm_state rescued Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'server_id': 'ba64c9aa-8ed7-4020-8fcb-90e39eab659b', 'body': {'volumeAttachment': {'volumeId': '882ffafc-33ef-43b3-9bf8-9352c832c10c'}}} Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:58:06.183987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b while it is in vm_state rescued Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:58:06.185339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:58:06.186858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:58:06.186858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:58:06.186858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b while it is in vm_state rescued Oct 17 17:58:06.186858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 17:58:06.188012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Returning 409 to user: Cannot 'attach_volume' instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b while it is in vm_state rescued {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:58:06.189104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e45db2d6-b54d-4ce7-93fa-7b44a4684b20 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055557 Oct 17 17:58:06.194960 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 128/250] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 17:58:06 2022] POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 17:58:06.199084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:06.200214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:06.208641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:06.210871 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:06.211486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.212402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:06.213061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:06.213652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.466161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-908ee37d-f14e-4009-8206-07bc7532c42b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/action" status: 202 len: 0 microversion: 2.1 time: 0.270994 Oct 17 17:58:06.469291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 123/251] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 17:58:06 2022] POST /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 17:58:06.478459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:06.479273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:06.487919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:06.488413 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:06.488880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.489703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:06.490160 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:06.491113 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:06.683449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:06.695809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-36027d64-0fa3-47e6-8800-f1d808ae3e87 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1509 microversion: 2.1 time: 0.222196 Oct 17 17:58:06.697111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 129/252] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:06 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:07.120747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:07.120747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:07.126970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:07.127708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:07.128821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:07.129713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:07.130144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:07.130715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:07.506783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:07.520346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-968fd504-45f7-416a-8b57-6e9667ffc265 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.408468 Oct 17 17:58:07.521302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 124/253] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:07 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:07.719790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:07.720858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:07.733119 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:07.736753 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:07.737646 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:07.738548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:07.741457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:07.742217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:07.805563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-ee89b968-b0d0-492a-ac6e-61987c8bd13f req-c8c2ad8f-c5b2-42de-9d1f-a0c2de82f454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707b0a09-7cd8-4076-8b97-f95d51716d88", "tag": "1bf643cd-3450-4c5e-810e-ef91a891efc8"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:07.816807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-ee89b968-b0d0-492a-ac6e-61987c8bd13f req-c8c2ad8f-c5b2-42de-9d1f-a0c2de82f454 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:07.827327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-ee89b968-b0d0-492a-ac6e-61987c8bd13f req-c8c2ad8f-c5b2-42de-9d1f-a0c2de82f454 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:07.827881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-ee89b968-b0d0-492a-ac6e-61987c8bd13f req-c8c2ad8f-c5b2-42de-9d1f-a0c2de82f454 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:07.832257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:07.842724 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-ee89b968-b0d0-492a-ac6e-61987c8bd13f req-c8c2ad8f-c5b2-42de-9d1f-a0c2de82f454 service nova] Creating event network-changed:1bf643cd-3450-4c5e-810e-ef91a891efc8 for instance 707b0a09-7cd8-4076-8b97-f95d51716d88 on hv-cinder-86160 Oct 17 17:58:07.854045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-ee89b968-b0d0-492a-ac6e-61987c8bd13f req-c8c2ad8f-c5b2-42de-9d1f-a0c2de82f454 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Oct 17 17:58:07.856930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 125/254] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:58:07.972081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:07.995450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:08.079246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:08.091507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c7de907f-5eae-434c-a2b1-aad7b24274c8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1509 microversion: 2.1 time: 0.375932 Oct 17 17:58:08.092324 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 130/255] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:07 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:08.485507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1970b1d-27d1-411f-9126-0476b528d495"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:08.489113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:08.496172 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:08.497312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:08.497921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:08.498788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:08.499403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:08.499980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:08.546111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:08.547024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:08.556430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:08.557397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:08.557985 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:08.560358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:08.560358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:08.560358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:08.880549 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:08.889132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9f1d879c-d737-47c3-b1a6-f07a2ea314d5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.348419 Oct 17 17:58:08.889882 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 131/256] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:08 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:09.114675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:09.116550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:09.122673 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:09.123384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:09.123802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:09.124824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:09.125421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:09.126034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:09.302683 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=4 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:09.327475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:09.336748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5738719d-8f74-4dc0-b7b7-c8688a6d6ed7 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1509 microversion: 2.1 time: 0.225915 Oct 17 17:58:09.348794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 132/257] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:09 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:09.905036 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:09.905612 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:09.912327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:09.913661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:09.914404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:09.915709 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:09.916421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:09.917013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:09.960635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ee4bc481-6c49-45c5-bd60-cb794025dfc9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/ips" status: 200 len: 153 microversion: 2.20 time: 0.047379 Oct 17 17:58:09.970249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 133/258] 10.222.0.58 () {60 vars in 1289 bytes} [Mon Oct 17 17:58:09 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/ips => generated 153 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 17:58:09.980980 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:09.981966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:09.988384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:09.989810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:09.991061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:09.992380 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:09.993058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:09.993793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:10.223505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:10.233180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6aba0b37-d97b-4a8a-87e5-565bbdcba73f tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.261782 Oct 17 17:58:10.233903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 134/259] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:09 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:10.362476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:10.363375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:10.375113 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:10.376470 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:10.377122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:10.378189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:10.378873 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:10.379504 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:10.713200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:10.723355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fd41f30c-c578-41a6-9f2e-79a82cb39d2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1515 microversion: 2.1 time: 0.365539 Oct 17 17:58:10.727472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 135/260] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:10 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:11.145924 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fbf83517-2ccb-4904-8074-ec0c8e9590b1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.666002 Oct 17 17:58:11.148325 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 126/261] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 17:58:08 2022] POST /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments => generated 194 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:11.260978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:11.260978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:11.274344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:11.274824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:11.275251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:11.276109 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:11.276472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:11.276965 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:11.418394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:11.426697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e2516fa8-d7ae-46fc-aa60-e0d0d9d11cec tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.173262 Oct 17 17:58:11.427743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 136/262] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:11 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:12.455404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:12.456192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:12.466658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:12.467186 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:12.467627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:12.472729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:12.472729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:12.473210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:12.619643 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:12.629195 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4e97fca8-2d73-4a2e-be26-1b78b2d7bbc5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.178524 Oct 17 17:58:12.629996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 127/263] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:12 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:13.652844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:13.658412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:13.660633 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:13.661357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:13.662046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:13.663588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:13.664258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:13.665003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:13.828582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:13.838464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-355455c1-aeb2-407c-9a35-ee6597aa45c2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.189536 Oct 17 17:58:13.843069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 137/264] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:13 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:14.872975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:14.873552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:14.885005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:14.885005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:14.885735 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:14.886122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:14.886775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:14.887534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:15.386111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:15.400091 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1ee6dda8-9c7b-4593-829d-bf1cf4e629d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.530893 Oct 17 17:58:15.400746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 128/265] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:14 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:15.910806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:15.912355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:15.933557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:15.933557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:15.933557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:15.933557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:15.933914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:15.937724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:15.979913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lazy-loading 'flavor' on Instance uuid d932b27f-b1fd-42b4-a8e3-3908063839da {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:58:16.013467 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4b7d2315-25d6-448f-8e71-6f4ff5b85ea9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'create', calling method: .version_select at 0x7f01963fe670>, body: {"keypair": {"name": "tempest-keypair-430901430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj8GoL1uIz96XigqJNpcHGWnKh3SzTQ0ytljyukIjzzP7YkRgSGuobC15+x1e60PjuHD4VEUVUL6cDo8v9RewgwEFs2aOHz3JhbttvKmPguyCmwa3jkgSyWDOBX2tYq6g=="}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:16.038639 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-4b7d2315-25d6-448f-8e71-6f4ff5b85ea9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for project 54dacea98b1448ab828595f9e1c31a13. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:58:16.042739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-4b7d2315-25d6-448f-8e71-6f4ff5b85ea9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for user af69042a7ac34adb92bae0288e51aa76 and project 54dacea98b1448ab828595f9e1c31a13. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:58:16.204169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4b7d2315-25d6-448f-8e71-6f4ff5b85ea9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194896 Oct 17 17:58:16.205317 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 129/266] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 17:58:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:58:16.433091 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:16.434342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:16.448017 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:16.455921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:16.456474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:16.457599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:16.458248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:16.459116 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:16.659635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d83b3459-e3ee-45c3-b3ce-a72540fd90de tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/action" status: 202 len: 0 microversion: 2.20 time: 0.756024 Oct 17 17:58:16.660632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 138/267] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 17 17:58:15 2022] POST /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 17:58:16.686348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:16.688891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:16.698299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:16.699144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:16.699937 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:16.701060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:16.701756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:16.702391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:16.708462 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:16.727743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-31c3f942-6c1a-4009-b2b3-6bf7c80c0549 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.300770 Oct 17 17:58:16.743291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 130/268] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:16 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:17.010478 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:17.020669 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:17.022997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:17.024359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-85dda661-c1d3-471b-84b6-30351a0e03cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.344480 Oct 17 17:58:17.025115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 139/269] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:16 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:17.760230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:17.760865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:17.779282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:17.780684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:17.781454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:17.783744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:17.784823 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:17.802708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:18.052378 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:18.053838 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:18.066181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:18.066677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:18.067105 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:18.070871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:18.071359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:18.073060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:18.134484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:18.157407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1a98e2f4-d809-4b7a-9422-4fba1314ab29 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.403364 Oct 17 17:58:18.189939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 131/270] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:17 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:18.476408 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:18.491427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:18.500677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:18.506828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9caa31c1-4e3f-4738-b7cf-7a85aa58078d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.454818 Oct 17 17:58:18.506828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 140/271] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:18 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:19.185876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:19.187163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:19.200021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:19.200812 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:19.201414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:19.202422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:19.204021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:19.204445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:19.230425 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:19.266976 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5408f5a2-8b20-410f-9e0b-cce15bc25488 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Action: 'create', calling method: .version_select at 0x7f0196324af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1896343550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBwbr2mU6BM1JhxMxDPl0VdTpuPTMyIBb6Uej8eERNUzSrJbxjGBAdOll+GbVfwr2VCRH6M2suDIrNTUxb5IaQGdQ2PAeeyOxxqoTbJtdz2p18+sGfaPRcjVbP2/7Oe1g=="}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:19.284103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-5408f5a2-8b20-410f-9e0b-cce15bc25488 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for project 1c70a04a649248c6a629325d44c380b9. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:58:19.290013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-5408f5a2-8b20-410f-9e0b-cce15bc25488 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for user ec7790cac2cb4e7cb68b5a2e3a91d5ec and project 1c70a04a649248c6a629325d44c380b9. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:58:19.421347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5408f5a2-8b20-410f-9e0b-cce15bc25488 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.435959 Oct 17 17:58:19.427492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:19.436302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 132/272] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 17:58:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:19.446437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-275cbe88-e5d3-4c99-9650-88e73ac970f1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.265599 Oct 17 17:58:19.447612 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 141/273] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:19 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:19.532695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:19.532695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:19.543204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:19.543781 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:19.544286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:19.545250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:19.545880 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:19.547568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:19.789279 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:19.798447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:19.799877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:19.801052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e07f851d-b10d-4015-9cab-d23f2cf0d902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.274665 Oct 17 17:58:19.801613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 133/274] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:19 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:20.061175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1530568899", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f34f9ee2-0de6-411c-a470-1298193c82aa"}], "security_groups": [{"name": "tempest-securitygroup--1441707172"}], "key_name": "tempest-keypair-430901430", "user_data": "}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:20.203025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-2f69b0d3-3826-4347-8482-21ba3cc6871f req-95d15f88-bad6-4e80-bc23-6cd585592048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707b0a09-7cd8-4076-8b97-f95d51716d88", "name": "network-vif-plugged", "status": "completed", "tag": "1bf643cd-3450-4c5e-810e-ef91a891efc8"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:20.216066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-2f69b0d3-3826-4347-8482-21ba3cc6871f req-95d15f88-bad6-4e80-bc23-6cd585592048 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.216545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-2f69b0d3-3826-4347-8482-21ba3cc6871f req-95d15f88-bad6-4e80-bc23-6cd585592048 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.217267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-2f69b0d3-3826-4347-8482-21ba3cc6871f req-95d15f88-bad6-4e80-bc23-6cd585592048 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:20.225971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] validate_networks() for [('f34f9ee2-0de6-411c-a470-1298193c82aa', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:58:20.229065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-2f69b0d3-3826-4347-8482-21ba3cc6871f req-95d15f88-bad6-4e80-bc23-6cd585592048 service nova] Creating event network-vif-plugged:1bf643cd-3450-4c5e-810e-ef91a891efc8 for instance 707b0a09-7cd8-4076-8b97-f95d51716d88 on hv-cinder-86160 Oct 17 17:58:20.234184 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-2f69b0d3-3826-4347-8482-21ba3cc6871f req-95d15f88-bad6-4e80-bc23-6cd585592048 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034961 Oct 17 17:58:20.234785 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 134/275] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:58:20.475742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:20.477753 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:20.486211 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.486865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.487649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:20.488455 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.489028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.489566 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:20.750356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:20.771573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-374f4cfe-cf30-4059-93fe-77fa90742480 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.302653 Oct 17 17:58:20.772958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 135/276] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:20 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:20.827297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:20.827925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:20.834484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.834770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.835210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:20.836960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.836960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.837094 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:20.971286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:58:20.971744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:58:20.972162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:58:20.972560 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:58:20.973677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:58:20.989200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.991462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.992373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:20.993484 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:20.994294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:20.995140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:21.042279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for project 54dacea98b1448ab828595f9e1c31a13. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:58:21.051505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Getting quotas for user af69042a7ac34adb92bae0288e51aa76 and project 54dacea98b1448ab828595f9e1c31a13. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:58:21.063006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:21.073603 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:58:21.075799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:21.077171 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:58:21.077684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:21.079225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-43ddb31a-da43-4d45-a1e5-32f3f29ff00c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.255970 Oct 17 17:58:21.093310 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 136/277] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:20 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:58:21.269037 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9d06b6fc-f097-4fe0-a0ca-1eb4edf42b9f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.212697 Oct 17 17:58:21.277004 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 142/278] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:58:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:58:21.286136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e8e93a2b-67bc-47cf-bf4a-2b33e29d2bd4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:21.287089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e8e93a2b-67bc-47cf-bf4a-2b33e29d2bd4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:21.387807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e8e93a2b-67bc-47cf-bf4a-2b33e29d2bd4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:21.394870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e8e93a2b-67bc-47cf-bf4a-2b33e29d2bd4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1245 microversion: 2.1 time: 0.116660 Oct 17 17:58:21.397366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 137/279] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:21 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:21.797091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:21.797732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:21.811010 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:21.812217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:21.813043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:21.819289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:21.819289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:21.819289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:22.110679 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:22.111419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:22.122393 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:22.123084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:22.124997 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:22.126597 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:22.127249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:22.128411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:22.188192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:22.197044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3a450d5d-8c40-4b85-8e4b-3b6769dae070 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1319 microversion: 2.1 time: 0.404237 Oct 17 17:58:22.197612 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 143/280] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:21 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:22.422570 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1ed68d53-8268-4375-a8fc-a5e1b895026e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:22.423178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1ed68d53-8268-4375-a8fc-a5e1b895026e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:22.623621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1ed68d53-8268-4375-a8fc-a5e1b895026e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:22.634527 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1ed68d53-8268-4375-a8fc-a5e1b895026e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1245 microversion: 2.1 time: 0.215636 Oct 17 17:58:22.635544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 144/281] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:22 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1245 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:22.739916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:22.751131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:22.752952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:22.754372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8373a957-ae63-4ae5-ac7c-6441e978a1ec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.648266 Oct 17 17:58:22.755051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 138/282] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:22 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:58:23.228075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:23.229041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:23.235320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:23.236081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:23.236967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:23.237881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:23.238569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:23.239190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:23.511496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:23.520304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0f56b283-2a0f-4831-a5e8-d369717ec28a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1507 microversion: 2.1 time: 0.296870 Oct 17 17:58:23.537003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 145/283] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:23 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:23.659151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:23.660853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:23.684146 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:23.690749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:23.693923 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:23.695105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:23.696263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:23.697353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:23.698454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:23.782823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:23.783433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:23.790499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:23.790899 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:23.791334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:23.792046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:23.815689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:23.817747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:23.856230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:23.867710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1af5de32-152e-447e-a5d6-c922ed821d6c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1249 microversion: 2.1 time: 0.213228 Oct 17 17:58:23.868949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 139/284] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:23 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1249 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:24.193473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:24.210335 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:24.216169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:24.217820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0801ead4-851b-4b66-96c8-6c81d923c7f9 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.439059 Oct 17 17:58:24.221262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 146/285] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:23 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:24.891506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:24.892300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:24.900067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:24.900832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:24.901452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:24.902453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:24.903059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:24.903638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:24.985404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:24.995778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3239feee-5b0b-4987-b152-91ce638a3221 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1297 microversion: 2.1 time: 0.106983 Oct 17 17:58:24.997125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 140/286] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:24 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:25.245648 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:25.247358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:25.252234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:25.252746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:25.253181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:25.253914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:25.254361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:25.254778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:25.403956 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:25.413664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:25.415081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:25.416863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d2801746-1956-4a68-907f-1e80627fb2df tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.174511 Oct 17 17:58:25.417796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 147/287] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:25 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:25.770052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2dd23838-30e7-4853-bd20-5c535c118cd7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: .version_select at 0x7f0196496550>, body: {"keypair": {"name": "tempest-keypair-847501047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiaJFf9Oa+AvYT55Czyc4iglg0uGqMu7LqpusGgshYn4M4ItrXHr3DQOYRH0pLiSNtY6+VXpNKXHKfeMcqm9ccG/gDqt8/VR5r0wwWAGuujBtOjfFYO87ddZvsZolVfZg=="}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:25.787936 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-2dd23838-30e7-4853-bd20-5c535c118cd7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:58:25.792123 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-2dd23838-30e7-4853-bd20-5c535c118cd7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:58:26.059681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:26.059681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:26.059681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:26.059681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:26.060361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:26.060361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:26.060361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:26.060361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:26.100422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:26.108453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2f2e4cf9-fc7d-4123-bb6c-bf5c4eb6ebf4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1315 microversion: 2.1 time: 0.087423 Oct 17 17:58:26.109031 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 148/288] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:26 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:26.186752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2dd23838-30e7-4853-bd20-5c535c118cd7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.420710 Oct 17 17:58:26.191355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 141/289] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 17:58:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:26.445521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:26.449032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:26.452455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:26.453081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:26.453792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:26.454810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:26.455279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:26.455698 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:26.626433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:26.634861 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:26.636297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:26.637469 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-996ff0e6-aaef-4ea1-abcf-784b954e9c1b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.196739 Oct 17 17:58:26.638021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 149/290] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:26 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:27.132483 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:27.133113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:27.140028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:27.141045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:27.141476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:27.142381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:27.142985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:27.143557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:27.284782 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:27.293135 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-dd28cdf2-73f3-4385-9c3c-18d7c4ad0bdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.165880 Oct 17 17:58:27.295919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 142/291] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:27 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:27.551306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1056510844", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:27.664434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:27.665345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:27.671369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:27.671848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:27.672285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:27.673001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:27.673456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:27.673912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:27.901443 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:27.920367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:27.920367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:27.921567 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-38d33965-a530-44c0-afec-69be72c81109 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.261989 Oct 17 17:58:27.922148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 143/292] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:27 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:58:27.930186 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-3ba7d4d8-d668-445b-b96a-683426fe49b6 req-51f88747-480c-438d-8cec-664db7d6d35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62268bc4-006f-4d44-a766-5930b2cca957", "tag": "2daf7e50-35c4-4647-922d-cb793b70fe1d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:27.946726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-3ba7d4d8-d668-445b-b96a-683426fe49b6 req-51f88747-480c-438d-8cec-664db7d6d35a service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:27.947157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-3ba7d4d8-d668-445b-b96a-683426fe49b6 req-51f88747-480c-438d-8cec-664db7d6d35a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:27.947578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-3ba7d4d8-d668-445b-b96a-683426fe49b6 req-51f88747-480c-438d-8cec-664db7d6d35a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:27.961029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-3ba7d4d8-d668-445b-b96a-683426fe49b6 req-51f88747-480c-438d-8cec-664db7d6d35a service nova] Creating event network-changed:2daf7e50-35c4-4647-922d-cb793b70fe1d for instance 62268bc4-006f-4d44-a766-5930b2cca957 on hv-cinder-86160 Oct 17 17:58:27.967222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-3ba7d4d8-d668-445b-b96a-683426fe49b6 req-51f88747-480c-438d-8cec-664db7d6d35a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041683 Oct 17 17:58:27.968002 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 144/293] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:28.318893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:28.319858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:28.326563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:28.327111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:28.327542 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:28.328345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:28.328817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:28.329318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:28.542267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:28.550470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-58005df0-66b2-4a74-a6ae-6f0c3ad6541e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.236735 Oct 17 17:58:28.551187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 145/294] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:28 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:28.952680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:28.953480 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:28.968643 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:28.969398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:28.970358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:28.971790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:28.972411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:28.974359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:29.005152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:29.134699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:29.142818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:29.144250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:29.145466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ad15bd97-b499-419e-9635-cc6ad3a53284 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.200747 Oct 17 17:58:29.146150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 146/295] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:28 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:29.152949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-639578016", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a6940ab-f26f-4946-9f58-3b74b9998843"}], "security_groups": [{"name": "tempest-securitygroup--592902401"}], "key_name": "tempest-keypair-847501047", "user_data": "}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:31.014997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:32.629925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=8 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:35.804204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=14 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:36.630563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=41 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:37.561129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:39.162960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:39.311006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:42.286188 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] validate_networks() for None {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:58:42.473447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] validate_networks() for [('7a6940ab-f26f-4946-9f58-3b74b9998843', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:58:42.694085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:58:42.694521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:58:42.694963 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:58:42.695366 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:58:42.695799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:58:42.710035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:42.710726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:42.711481 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:42.712853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:42.713578 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:42.714073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:42.746846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Getting quotas for project 523bb17ba81d4ce1a7b86807b9c1b13b. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:58:42.752279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Getting quotas for user eb4aa732c95c42929fa975d5d389ce78 and project 523bb17ba81d4ce1a7b86807b9c1b13b. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:58:42.765181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:58:42.770324 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:58:42.894928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e13d33d3-7a0a-4074-b561-4be3fb81b965 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.347573 Oct 17 17:58:42.895851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 150/296] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:58:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 15349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:58:42.901005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:42.902087 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:42.910153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:42.912181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:42.912181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:42.912181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:42.913201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:42.913201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:43.079022 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:58:43.079440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:58:43.079906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:58:43.080309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:58:43.080751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:58:43.092731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:43.093215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:43.093650 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:43.094375 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:43.094862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:43.095302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:43.105396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:43.113317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f6358f90-c599-4728-af01-830d7efe7399 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.216239 Oct 17 17:58:43.113879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 151/297] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:42 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:43.117214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:58:43.120008 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:43.120615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:43.121335 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:58:43.126772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:43.127346 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:43.127770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:43.128760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:43.129207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:43.129627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:43.132717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:58:43.135017 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:58:43.266212 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:43.274198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:43.275624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:43.276832 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b896f99a-8dea-419f-afe2-5cb215dab08b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.161598 Oct 17 17:58:43.277379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 152/298] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:43 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:43.282428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-85b6d47c-733b-412f-b31a-534622c2ce10 req-4d9dab79-cf00-4625-a4a4-2833fba978df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "name": "network-vif-plugged", "status": "completed", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:43.293545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d3a588d6-149e-4cb4-8325-43b464e10c3c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 14.144800 Oct 17 17:58:43.294981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 147/299] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:58:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 14148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:58:43.296398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-85b6d47c-733b-412f-b31a-534622c2ce10 req-4d9dab79-cf00-4625-a4a4-2833fba978df service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:43.296978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-85b6d47c-733b-412f-b31a-534622c2ce10 req-4d9dab79-cf00-4625-a4a4-2833fba978df service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:43.297427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-85b6d47c-733b-412f-b31a-534622c2ce10 req-4d9dab79-cf00-4625-a4a4-2833fba978df service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:43.301007 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-28a0714c-324d-4f55-aa88-59b79b85fa34 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:43.303029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-28a0714c-324d-4f55-aa88-59b79b85fa34 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:43.321328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-85b6d47c-733b-412f-b31a-534622c2ce10 req-4d9dab79-cf00-4625-a4a4-2833fba978df service nova] Creating event network-vif-plugged:159ad1ae-f38b-4dca-afd5-a41b7031cb8c for instance d932b27f-b1fd-42b4-a8e3-3908063839da on hv-cinder-86160 Oct 17 17:58:43.328128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-85b6d47c-733b-412f-b31a-534622c2ce10 req-4d9dab79-cf00-4625-a4a4-2833fba978df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049355 Oct 17 17:58:43.328681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 153/300] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:43.334161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3c9d9173-98bb-4796-81fc-58366d7c0319 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:43.334844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3c9d9173-98bb-4796-81fc-58366d7c0319 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:43.365124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-28a0714c-324d-4f55-aa88-59b79b85fa34 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:43.372539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-28a0714c-324d-4f55-aa88-59b79b85fa34 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1215 microversion: 2.1 time: 0.076334 Oct 17 17:58:43.373304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 148/301] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:43 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:43.402433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3c9d9173-98bb-4796-81fc-58366d7c0319 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:43.410754 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3c9d9173-98bb-4796-81fc-58366d7c0319 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1240 microversion: 2.1 time: 0.080625 Oct 17 17:58:43.411598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 154/302] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:43 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:44.138065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:44.141208 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:44.148662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.149087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.149523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.150220 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.150678 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.151105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.316075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:44.320776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:44.343644 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:44.351861 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5dde3705-0fb1-4527-acfe-8fc65810c889 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.219232 Oct 17 17:58:44.352491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 149/303] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:44 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:44.353473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.354054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.354500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.355254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.359564 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.362746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.405968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:44.405968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:44.407935 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.408700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.409349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.412361 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.413209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.413935 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.526380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:44.537119 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7b6f3623-fa25-42b2-9221-90972ab78c2c tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1219 microversion: 2.1 time: 0.143855 Oct 17 17:58:44.538271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 150/304] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:44 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:44.543350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:44.544233 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:44.551552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.552550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.553477 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.554671 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:44.555341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:44.556491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:44.589776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:44.604369 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:44.605946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:44.607107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a06b061e-d126-43cb-ad7a-0c670af62aeb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.306655 Oct 17 17:58:44.607697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 155/305] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:44 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:44.638153 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:44.647173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9830f294-104d-4f8a-8ce2-cb59e1cf14f3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1244 microversion: 2.1 time: 0.107661 Oct 17 17:58:44.648336 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 151/306] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:44 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:45.417045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:45.418135 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:45.441129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.442206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.443223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.444757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.445758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.446729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.566068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:45.567360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:45.584945 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.586756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.587529 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.588758 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.590339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.591426 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.649397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:45.654354 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2c59f373-e938-428c-a384-dae971fa42a8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.247976 Oct 17 17:58:45.655624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 156/307] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:45 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:45.660760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:45.661615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:45.688181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.689656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.690136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.690868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.691334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.691761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.703707 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:45.723913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e48144aa-4b5a-402f-8a84-f8f390febc6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1267 microversion: 2.1 time: 0.163228 Oct 17 17:58:45.734020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 152/308] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:45 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:45.749240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:45.750297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:45.756889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.757623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.758237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.759100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:45.759708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:45.760404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:45.881996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:45.893183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:45.894659 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:45.895878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-89af03fa-b9bd-4abf-8745-127b650f90f3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.238902 Oct 17 17:58:45.896454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 157/309] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:45 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:46.031517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:46.048066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-450e4097-2bf9-4cc2-a20f-6947b66dc8a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1236 microversion: 2.1 time: 0.311060 Oct 17 17:58:46.056743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 153/310] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:45 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1236 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:46.683044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:46.683678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:46.693203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:46.693835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:46.695071 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:46.697177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:46.697745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:46.698405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:46.754720 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:46.755937 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:46.769740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:46.770253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:46.770682 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:46.771676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:46.773752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:46.774453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:46.948890 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:46.960745 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fda8f8df-d92f-4960-8b0b-3c6add44f055 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1275 microversion: 2.1 time: 0.209813 Oct 17 17:58:46.967682 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 154/311] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:46 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:46.975243 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:46.981484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:46.988791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:46.989564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:46.990205 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:46.991113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:46.991742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:46.992359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:47.005519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:47.014381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3d04951f-1663-4ea4-bdeb-bd9275053df6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.340673 Oct 17 17:58:47.015486 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 158/312] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:46 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:47.074414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:47.075768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:47.099934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:47.099934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:47.099934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:47.099934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:47.100250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:47.100250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:47.214263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:47.238640 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-98017636-68f6-4fdb-8d58-71de0abfaaf8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1292 microversion: 2.1 time: 0.170131 Oct 17 17:58:47.242886 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 159/313] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:47 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1292 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:47.275881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:47.286659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:47.288187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:47.289484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6a679f68-6e0d-407f-9a47-1d272ff9a778 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.320064 Oct 17 17:58:47.290090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 155/314] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:46 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:47.987428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:47.993746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:47.994626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:47.994626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:47.995074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.003172 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.003752 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.004241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.040089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:48.041403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:48.055727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.056572 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.057576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.059374 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.060014 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.063777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.293377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:48.315180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0d6da614-f797-4530-a890-2f62c20f19ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.331508 Oct 17 17:58:48.318591 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 160/315] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:47 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:48.347157 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:48.347782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:48.361816 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.364553 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.365220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.366594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.367055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.367481 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.499458 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:48.509472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c1331450-de43-48f5-8549-4c8d94c11c9e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1298 microversion: 2.1 time: 0.175531 Oct 17 17:58:48.517473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 161/316] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:48 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1298 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:48.523865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:48.532507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bf17af56-f567-42fd-923e-abdb934a8701 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.498017 Oct 17 17:58:48.535693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 156/317] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:48 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:48.537766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:48.544457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:48.556417 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.563124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.564205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.565231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.565884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.566476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.597047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-22a5c041-d372-47e4-bf90-bd4d752d2ee7 req-40a4d102-0a7a-4205-8967-cbef5b749dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62268bc4-006f-4d44-a766-5930b2cca957", "name": "network-vif-plugged", "status": "completed", "tag": "2daf7e50-35c4-4647-922d-cb793b70fe1d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:48.618066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-22a5c041-d372-47e4-bf90-bd4d752d2ee7 req-40a4d102-0a7a-4205-8967-cbef5b749dea service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:48.619017 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-22a5c041-d372-47e4-bf90-bd4d752d2ee7 req-40a4d102-0a7a-4205-8967-cbef5b749dea service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:48.619742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-22a5c041-d372-47e4-bf90-bd4d752d2ee7 req-40a4d102-0a7a-4205-8967-cbef5b749dea service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:48.633968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-22a5c041-d372-47e4-bf90-bd4d752d2ee7 req-40a4d102-0a7a-4205-8967-cbef5b749dea service nova] Creating event network-vif-plugged:2daf7e50-35c4-4647-922d-cb793b70fe1d for instance 62268bc4-006f-4d44-a766-5930b2cca957 on hv-cinder-86160 Oct 17 17:58:48.641218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-22a5c041-d372-47e4-bf90-bd4d752d2ee7 req-40a4d102-0a7a-4205-8967-cbef5b749dea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047804 Oct 17 17:58:48.645813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 157/318] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:58:48.935797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:48.949105 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:48.950667 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:48.952582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a993d3fb-eefe-4639-9443-d9b20ff56633 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.433858 Oct 17 17:58:48.968622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 162/319] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:48 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:49.349602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:49.351326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:49.360769 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.361881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.364289 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.372218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.390201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.404627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.539733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:49.540452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:49.548284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.549249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.550153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.551239 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.551930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.552572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.616495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:49.627044 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8846ff99-9e0d-41fe-91c6-82357208ef22 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.283659 Oct 17 17:58:49.630704 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 158/320] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:49 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:49.646641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:49.647510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:49.656712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.657415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.658047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.658767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.659383 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.659973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.776518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:49.791943 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5ef15d19-f52b-422d-ae39-c618dc61eb2f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.256199 Oct 17 17:58:49.809137 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 163/321] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:49 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:49.824742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-be29df8a-9e13-4fb2-86d9-32a914a3bb7f req-8ac4a52e-0428-4a69-b34c-6563feedbbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cad671-1640-450b-86cb-0edf44cf2621", "tag": "adaf3359-ca21-4df6-9e27-e04057411a0e"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:49.845574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-be29df8a-9e13-4fb2-86d9-32a914a3bb7f req-8ac4a52e-0428-4a69-b34c-6563feedbbd5 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.845574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-be29df8a-9e13-4fb2-86d9-32a914a3bb7f req-8ac4a52e-0428-4a69-b34c-6563feedbbd5 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.845574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-be29df8a-9e13-4fb2-86d9-32a914a3bb7f req-8ac4a52e-0428-4a69-b34c-6563feedbbd5 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.857075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-be29df8a-9e13-4fb2-86d9-32a914a3bb7f req-8ac4a52e-0428-4a69-b34c-6563feedbbd5 service nova] Creating event network-changed:adaf3359-ca21-4df6-9e27-e04057411a0e for instance 33cad671-1640-450b-86cb-0edf44cf2621 on hv-cinder-86160 Oct 17 17:58:49.867607 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-be29df8a-9e13-4fb2-86d9-32a914a3bb7f req-8ac4a52e-0428-4a69-b34c-6563feedbbd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056773 Oct 17 17:58:49.868634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 164/322] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:49.926662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:49.937946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7321c3d7-c856-4167-91b6-605d6ef00cbd tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.305761 Oct 17 17:58:49.940528 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 159/323] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:49 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:49.982220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:49.986466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:49.995893 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.996628 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:49.997229 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:49.998919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:49.999653 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.000231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:50.607422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:50.630288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:50.632379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:50.633690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9807eadb-e473-4dd4-ad10-3e3b232466af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.656012 Oct 17 17:58:50.647249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 165/324] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:49 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:50.652581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:50.653955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:50.672452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:50.672452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.672452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:50.672452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:50.672939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.672939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:50.825258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:50.827334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:50.835679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:50.836502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.837198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:50.838294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:50.838997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.839826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:50.881775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:50.895101 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1e49331c-0d6d-4f1f-a6f9-b67f4e5b2d64 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.246227 Oct 17 17:58:50.908620 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 160/325] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:50 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:50.964887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:50.965435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:50.984013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:50.984520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.985201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:50.986124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:50.987511 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:50.987955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:51.223784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:51.239217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-37590790-665e-4569-982f-7543d61481b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.420284 Oct 17 17:58:51.242738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 166/326] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:50 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:51.301534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:51.313108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a20bcc38-e104-4f75-9353-125d5cd4a242 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1371 microversion: 2.1 time: 0.355032 Oct 17 17:58:51.314027 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 161/327] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:50 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:51.620454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-c5af1fcf-2d1a-42d7-aed2-53870b973d4b req-8d25c9c6-5f41-4931-8a6d-46739e102719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675604a3-eb66-477f-ac4b-e12b1fbbdedd", "tag": "49866aa9-a434-48a8-b590-26fa09814985"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:51.636068 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-c5af1fcf-2d1a-42d7-aed2-53870b973d4b req-8d25c9c6-5f41-4931-8a6d-46739e102719 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:51.639226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-c5af1fcf-2d1a-42d7-aed2-53870b973d4b req-8d25c9c6-5f41-4931-8a6d-46739e102719 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:51.640016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-c5af1fcf-2d1a-42d7-aed2-53870b973d4b req-8d25c9c6-5f41-4931-8a6d-46739e102719 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:51.665435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-c5af1fcf-2d1a-42d7-aed2-53870b973d4b req-8d25c9c6-5f41-4931-8a6d-46739e102719 service nova] Creating event network-changed:49866aa9-a434-48a8-b590-26fa09814985 for instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd on hv-cinder-86160 Oct 17 17:58:51.671112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-c5af1fcf-2d1a-42d7-aed2-53870b973d4b req-8d25c9c6-5f41-4931-8a6d-46739e102719 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056462 Oct 17 17:58:51.672343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 167/328] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:51.679335 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:51.679947 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:51.697926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:51.698410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:51.698842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:51.699599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:51.700051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:51.700474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:51.922805 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:51.923526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:51.936205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.006785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.006785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.006785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.006785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.007294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.023314 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:52.040088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:52.042160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:52.043534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-426b64bd-b650-4192-8593-d599a809c59a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.381440 Oct 17 17:58:52.044241 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 162/329] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:51 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:58:52.191058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:52.205865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e2119f36-a203-4402-b479-94e5fbe5c30a tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.289711 Oct 17 17:58:52.206446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 168/330] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:51 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:52.270785 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:52.271384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:52.277350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.281180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.281180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.281180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.281180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.281867 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.339622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:52.340216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:52.347784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.348261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.348918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.349610 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.350058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.350473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.582503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:52.606460 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-10798c9f-9003-46fe-b9c9-59c7e82c16aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.339436 Oct 17 17:58:52.607419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 163/331] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:52 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:52.698426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:52.718771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e51797a5-dc5e-4c3d-aeb6-e01ff19b4d24 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1565 microversion: 2.1 time: 0.380477 Oct 17 17:58:52.718771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 169/332] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:52 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1565 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:52.743805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:52.744446 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:52.758891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.759810 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.760807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.764343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:52.764343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:52.764343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:52.882367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d72058cd-df3c-407c-b96f-7aecb3538d71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136278 Oct 17 17:58:52.883389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 164/333] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 17:58:52 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:53.073342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:53.073949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:53.075878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:53.081789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:53.082588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:53.083203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:53.084184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:53.084672 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:53.085103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:53.089310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:53.236961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:53.242642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:53.243873 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:53.252852 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:53.253608 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:53.257236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:53.261833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:53.269069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:53.269832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:53.270468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:53.273634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:53.279842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:53.282643 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b2b0b5e0-d6c1-4304-8989-bf2daa9fcca7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.211781 Oct 17 17:58:53.282643 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 170/334] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:53 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:53.369982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=8 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:53.446658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:53.454958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-48e04342-0d83-40bc-b5f9-8f30714ec344 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.219107 Oct 17 17:58:53.456125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 165/335] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:53 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:53.636688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:53.636688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:53.639467 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=8 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:53.644651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:53.645147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:53.645602 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:53.646370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:53.647355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:53.648261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:53.845124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:53.860876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0967c54f-e359-4263-a3d8-cba309c8dc3b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.231967 Oct 17 17:58:53.876621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 171/336] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:53 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:54.207603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-f83013c4-fc5e-4398-953c-f5d1af3eb2d1 req-f12a4d63-a67a-4e72-bcb0-924a05216caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62268bc4-006f-4d44-a766-5930b2cca957", "tag": "2daf7e50-35c4-4647-922d-cb793b70fe1d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:58:54.222524 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f83013c4-fc5e-4398-953c-f5d1af3eb2d1 req-f12a4d63-a67a-4e72-bcb0-924a05216caa service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.223009 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f83013c4-fc5e-4398-953c-f5d1af3eb2d1 req-f12a4d63-a67a-4e72-bcb0-924a05216caa service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.223449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f83013c4-fc5e-4398-953c-f5d1af3eb2d1 req-f12a4d63-a67a-4e72-bcb0-924a05216caa service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:54.227704 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:58:54.238330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-f83013c4-fc5e-4398-953c-f5d1af3eb2d1 req-f12a4d63-a67a-4e72-bcb0-924a05216caa service nova] Creating event network-changed:2daf7e50-35c4-4647-922d-cb793b70fe1d for instance 62268bc4-006f-4d44-a766-5930b2cca957 on hv-cinder-86160 Oct 17 17:58:54.246732 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-f83013c4-fc5e-4398-953c-f5d1af3eb2d1 req-f12a4d63-a67a-4e72-bcb0-924a05216caa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042729 Oct 17 17:58:54.250427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 166/337] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:58:54.307373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:54.308513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:54.317049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.318102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.318643 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:54.319464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.320153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.320999 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:54.481655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:54.482888 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:54.496194 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.496735 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.498093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:54.499049 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.499754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.500426 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:54.525843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:54.534174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:54.537249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:54.539282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c00ee36f-6172-42bc-8dfa-885cae4bff51 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.235983 Oct 17 17:58:54.559492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 172/338] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:54 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:58:54.722502 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:54.732550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-07cad964-075b-4778-999e-d2aff20bd1dc tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.254187 Oct 17 17:58:54.735438 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 167/339] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:54 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:54.888012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:54.888501 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:54.904256 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.904900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.905336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:54.906039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:54.910100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:54.910766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:55.102913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:55.111450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-881151e6-17fb-46a4-834b-23303437680e tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.227603 Oct 17 17:58:55.120838 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 173/340] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:54 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:55.567857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:55.568575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:55.577887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:55.578496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:55.579157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:55.579938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:55.580457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:55.581045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:55.750498 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:55.757536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:55.758058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:55.759174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:55.761064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:55.766476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-eeeba033-6612-459d-af90-e55634b97226 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.202648 Oct 17 17:58:55.767296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 168/341] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:55 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:55.769110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:55.770055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:55.770642 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:55.771864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:55.772863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:55.773678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:55.984882 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:55.991971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-55f900e6-9525-4b65-a6d0-48d90abe43e6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.238331 Oct 17 17:58:55.993226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 174/342] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:55 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:56.135492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:56.136265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:56.143174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:56.143730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:56.144228 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:56.145013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:56.145527 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:56.145981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:56.300204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:56.308520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-10fcdce6-a8e6-4922-bd89-e38f4a965aa1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.177055 Oct 17 17:58:56.309160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 169/343] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:56 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:56.799418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:56.800743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:56.809433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:56.810184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:56.811325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:56.813698 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:56.814626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:56.815764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:57.034988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:57.036263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:57.044129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:57.048144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:57.048874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:57.049537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:57.050408 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:57.051020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:57.051621 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:57.053625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:57.055076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:57.056249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c00c2be5-d36a-49d4-aaaf-f53c777a60cf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.263572 Oct 17 17:58:57.057046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 175/344] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:56 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:57.325093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:57.335250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7a2f9ce0-186e-4a55-998e-c5412b10c022 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.309514 Oct 17 17:58:57.335502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:57.335840 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 170/345] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:57 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:57.336182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:57.343792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:57.344382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:57.344905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:57.345689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:57.346223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:57.346738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:57.481893 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:57.490278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-83f5c391-eda3-4c90-9f25-8aed38a490bb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.158819 Oct 17 17:58:57.490843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:57 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:58.085500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:58.086110 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:58.092437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:58.092947 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:58.093388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:58.094094 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:58.094611 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:58.094985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:58.245146 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:58.255096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:58.256706 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:58.257906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ec1c4191-6c82-4757-a8ec-58fc78f96e7d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1741 microversion: 2.20 time: 0.176283 Oct 17 17:58:58.258514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 171/347] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:58 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:58.359283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:58.359912 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:58.365703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:58.366175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:58.366599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:58.367276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:58.367725 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:58.368139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:58.501745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:58.509971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c13bf905-5173-4c57-a028-d43fed327baf tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.155328 Oct 17 17:58:58.510814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 177/348] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:58 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:58.514288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:58.515161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:58.521920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:58.522654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:58.523284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:58.524172 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:58.524964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:58.525605 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:58.658045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:58.665926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-750f55a2-3e70-4a7d-921c-ba8ca36dd860 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.155934 Oct 17 17:58:58.666504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 172/349] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:58 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:58:59.283971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:59.284575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:59.290628 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:59.291104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:59.291530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:59.292234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:59.292783 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:59.293204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:59.508435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:59.517694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:59.519138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:59.520314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7bb17e98-be16-4ba0-8903-a2efdce57b02 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1723 microversion: 2.20 time: 0.240944 Oct 17 17:58:59.520900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 178/350] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:58:59 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:58:59.533518 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:59.534204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:59.541028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:59.541505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:59.541934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:59.542626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:59.543104 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:59.543546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:59.674946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:59.683132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-52ae0b2e-b836-4c8d-a3c0-cc97cbfc3079 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.153625 Oct 17 17:58:59.683888 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 173/351] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:59 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:58:59.691363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:58:59.692187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:58:59.698227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:59.698804 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:59.699340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:59.700107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:58:59.700668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:58:59.701163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:58:59.832905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:58:59.840876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fb6c695c-b206-463f-b762-abb780161192 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.153759 Oct 17 17:58:59.841468 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 179/352] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:58:59 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:00.330209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-135424390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1896343550", "security_groups": [{"name": "tempest-secgroup-smoke-490657498"}], "block_device_mapping_v2": [{"uuid": "c34e62df-9f65-47b6-848b-fae4c16afd56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5134453-24e2-45e3-8067-3e320705eb69"}]}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:00.444906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] validate_networks() for [('a5134453-24e2-45e3-8067-3e320705eb69', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 17:59:00.547441 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:00.547981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:00.554316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.554794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.555220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.555908 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.556360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.556823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.777129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:00.785283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:00.786726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:00.787858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-73dc741d-a228-4a55-9d03-be25ff514b90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1723 microversion: 2.20 time: 0.245239 Oct 17 17:59:00.788417 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 180/353] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:00 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:00.792764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:00.793353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:00.799183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.799580 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.800003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.800700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.801150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.801565 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.945680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 17:59:00.946189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 17:59:00.946557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 17:59:00.946964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 17:59:00.947380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 17:59:00.957381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.957873 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.958315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.959052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.959574 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.960001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.972756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:00.977712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for project 1c70a04a649248c6a629325d44c380b9. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 17:59:00.980268 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b058446d-c2c7-4ef7-bcba-213f3cb0b8c4 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.190893 Oct 17 17:59:00.992617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 181/354] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:00 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:00.992825 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for user ec7790cac2cb4e7cb68b5a2e3a91d5ec and project 1c70a04a649248c6a629325d44c380b9. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 17:59:00.992930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:00.992930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:00.992930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.992930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.993288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:00.993733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:00.997675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:00.997675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:01.047168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 17:59:01.049385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c34e62df-9f65-47b6-848b-fae4c16afd56',volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 17:59:01.128179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:01.136022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-75c89ed2-f66a-4670-a999-9be465b40636 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.154127 Oct 17 17:59:01.140424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 182/355] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:00 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:01.427912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a2cdaa0c-bad8-4a26-82ca-617572d77c07 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.102120 Oct 17 17:59:01.428846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 174/356] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 17:59:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 17:59:01.441476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ec7ac352-df96-436f-bbac-dcd5d200a30e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:01.442294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ec7ac352-df96-436f-bbac-dcd5d200a30e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:01.503275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ec7ac352-df96-436f-bbac-dcd5d200a30e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:01.510273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ec7ac352-df96-436f-bbac-dcd5d200a30e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1094 microversion: 2.1 time: 0.073885 Oct 17 17:59:01.511122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 183/357] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:01 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:01.677782 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-8b3d9d4b-8c71-48da-9307-50c5de8b3e89 req-5271492c-ce27-4f9c-b3c1-2b8195e8502c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675604a3-eb66-477f-ac4b-e12b1fbbdedd", "name": "network-vif-plugged", "status": "completed", "tag": "49866aa9-a434-48a8-b590-26fa09814985"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:01.689533 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8b3d9d4b-8c71-48da-9307-50c5de8b3e89 req-5271492c-ce27-4f9c-b3c1-2b8195e8502c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:01.689997 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8b3d9d4b-8c71-48da-9307-50c5de8b3e89 req-5271492c-ce27-4f9c-b3c1-2b8195e8502c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:01.690423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-8b3d9d4b-8c71-48da-9307-50c5de8b3e89 req-5271492c-ce27-4f9c-b3c1-2b8195e8502c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:01.702877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-8b3d9d4b-8c71-48da-9307-50c5de8b3e89 req-5271492c-ce27-4f9c-b3c1-2b8195e8502c service nova] Creating event network-vif-plugged:49866aa9-a434-48a8-b590-26fa09814985 for instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd on hv-cinder-86160 Oct 17 17:59:01.707757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-8b3d9d4b-8c71-48da-9307-50c5de8b3e89 req-5271492c-ce27-4f9c-b3c1-2b8195e8502c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034278 Oct 17 17:59:01.708348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 175/358] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:01.812829 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:01.813435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:01.819550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:01.820295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:01.820770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:01.821708 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:01.822259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:01.822941 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:01.976004 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:01.984497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:01.985979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:01.987134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-edff3f8f-1159-444c-88c1-e983a601c6f8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1726 microversion: 2.20 time: 0.178847 Oct 17 17:59:01.987876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 184/359] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:01 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:02.006889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:02.008111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:02.016875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c0cbbaf-f06c-4ace-9b8e-81d4cb9d9bdd"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:02.019313 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:02.024400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.024953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.026449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.026449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.026449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.026978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.045738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.046228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.046824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.047526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.047974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.048387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.538449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:02.548178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c5a18b6a-da85-4a4b-838b-d3622ede2130 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.546623 Oct 17 17:59:02.562772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 176/360] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:02 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:02.562772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:02.562772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:02.562772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.563320 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.563320 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.563320 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.563320 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.563646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.696011 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:02.704458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-783d2ded-ed86-410c-9d1e-1e16be0e889c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.154572 Oct 17 17:59:02.705056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 177/361] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:02 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:02.709725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:02.710332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:02.716002 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.716481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.716959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.718301 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:02.719683 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:02.719683 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:02.784549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:02.792293 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ba77ff54-66c7-4639-a33d-63e51123eeb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1144 microversion: 2.1 time: 0.086273 Oct 17 17:59:02.792884 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 178/362] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:02 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:03.099446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:03.178525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b0f83ecf-5466-4f17-841e-a20186153f55 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.165972 Oct 17 17:59:03.179144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 185/363] 10.222.0.58 () {62 vars in 1364 bytes} [Mon Oct 17 17:59:02 2022] POST /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments => generated 188 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 17:59:03.218778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8e2759c-817d-42bd-bb61-a883e9633f51", "device": "/dev/sdb"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:03.221828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:03.227889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.228378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.228845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.229548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.230005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.230428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.307307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:03.307997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:03.316388 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.316907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.317343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.318037 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.318493 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.318933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.362131 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126519) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 17:59:03.684207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0259e95c-094e-4145-98e7-a4daedb0ec62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/action" status: 202 len: 0 microversion: 2.20 time: 0.381143 Oct 17 17:59:03.685405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 186/364] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 17 17:59:03 2022] POST /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 17:59:03.696855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:03.697461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:03.705082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.705666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.706214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.707099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.708387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.709244 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.860961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:03.870826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-59fdb96f-5118-496d-be6d-1184fbbe12e3 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.179449 Oct 17 17:59:03.871415 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 187/365] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:03 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:03.878192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:03.878999 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:03.886323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.887169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.887824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:03.888528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:03.889150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:03.890237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.035391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:04.043992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:04.045505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:04.046688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-21f1a5f8-eeb2-4e65-9c5b-bc35283b6183 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1752 microversion: 2.20 time: 0.173764 Oct 17 17:59:04.047252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 188/366] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:03 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:04.051611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:04.052303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:04.054265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:04.058766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.059251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.059686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.060376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.060868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.061871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.199232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:04.203210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-722ff900-d56b-40c5-a03d-ecb7ec180760 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "POST /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.988234 Oct 17 17:59:04.216614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 179/367] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 17:59:03 2022] POST /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:04.216614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cad671-1640-450b-86cb-0edf44cf2621", "name": "network-vif-plugged", "status": "completed", "tag": "adaf3359-ca21-4df6-9e27-e04057411a0e"}, {"server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "name": "network-vif-unplugged", "status": "completed", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:04.217288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a2815f42-0ca3-4e73-b0e9-43d1aeeda693 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1365 microversion: 2.1 time: 0.162661 Oct 17 17:59:04.217288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 189/368] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:04 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:04.217468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:04.217551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:04.217551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:04.223383 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.224506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.225137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.225742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.226559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.226980 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.227668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.228178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.228530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.239496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] Creating event network-vif-plugged:adaf3359-ca21-4df6-9e27-e04057411a0e for instance 33cad671-1640-450b-86cb-0edf44cf2621 on hv-cinder-86160 Oct 17 17:59:04.244201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.compute.server_external_events [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] Unable to find a host for instance d932b27f-b1fd-42b4-a8e3-3908063839da. Dropping event network-vif-unplugged {{(pid=126522) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 17:59:04.245756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-abaa2272-cdc5-4a4b-bf9f-8c2d1b7d7a83 req-0319d44b-b87a-467b-b81f-ec19c67e9a3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.040688 Oct 17 17:59:04.246674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 180/369] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 17:59:04.303817 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:04.312150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-909dadd9-ffa8-4022-9288-352074f16266 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1136 microversion: 2.1 time: 0.099063 Oct 17 17:59:04.312748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 190/370] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:04 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1136 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:04.896267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:04.897016 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:04.904277 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.904783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.905971 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:04.907489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:04.907963 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:04.909064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.055438 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:05.063759 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-34bcfdd4-a08e-4a8d-85fd-43a26fe158ca tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.171757 Oct 17 17:59:05.064370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 181/371] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:04 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:05.073863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:05.074707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:05.082132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.082622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.083055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.083746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.084199 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.084639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.224571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:05.234574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:05.234987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:05.235679 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:05.236994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:05.238438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4ca0c74a-361f-4bcb-af85-c753fad1e5f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1752 microversion: 2.20 time: 0.168710 Oct 17 17:59:05.239058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 191/372] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:05 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:05.242349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.242902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.243412 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.244170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.244744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.245162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.336692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:05.337758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:05.345541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.348073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.348073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.348073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.348073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.349088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.386197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:05.395052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c7201945-6818-4b32-86e9-d1d7dc115332 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1555 microversion: 2.1 time: 0.164675 Oct 17 17:59:05.395693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 182/373] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:05 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:05.415739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:05.418091 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:05.418576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:05.424052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-19d615be-c893-42aa-806d-2cd1c96d3c7f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1192 microversion: 2.1 time: 0.091651 Oct 17 17:59:05.424734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 192/374] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:05 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:05.425271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.425746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.426177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.426966 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:05.427409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:05.427851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:05.508754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c1bb3826-214f-4120-8273-694cf4230756 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094301 Oct 17 17:59:05.509345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 183/375] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 17:59:05 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:06.087455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:06.088214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:06.094362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.094865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.095293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.098611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.098611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.098611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.266152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:06.266762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:06.274028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.274719 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.275299 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.276141 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.276796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.277213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.298073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:06.312458 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:06.320925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-90277041-1ad7-441f-ba0f-e2d7f1ea60ba tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1315 microversion: 2.1 time: 0.237236 Oct 17 17:59:06.321753 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 193/376] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:06 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:06.447580 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:06.448977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:06.454820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.455306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.455737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.456432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.456934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.457376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.535206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:06.544863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:06.547058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:06.548296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c0484850-3817-443a-9a0a-22a5a39efe2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.288009 Oct 17 17:59:06.548894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 184/377] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:06 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:06.557085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:06.567193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-201033bf-64c8-4517-9782-575135598212 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1200 microversion: 2.1 time: 0.123501 Oct 17 17:59:06.567990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 194/378] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:06 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1200 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:06.721290 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-e3ffceab-b0b5-4453-9bcd-da8f9525e732 req-a81f08c9-fcdd-48f8-a2ef-d240f844574c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675604a3-eb66-477f-ac4b-e12b1fbbdedd", "tag": "49866aa9-a434-48a8-b590-26fa09814985"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:06.731959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-e3ffceab-b0b5-4453-9bcd-da8f9525e732 req-a81f08c9-fcdd-48f8-a2ef-d240f844574c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:06.732434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-e3ffceab-b0b5-4453-9bcd-da8f9525e732 req-a81f08c9-fcdd-48f8-a2ef-d240f844574c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:06.732886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-e3ffceab-b0b5-4453-9bcd-da8f9525e732 req-a81f08c9-fcdd-48f8-a2ef-d240f844574c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:06.747272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-e3ffceab-b0b5-4453-9bcd-da8f9525e732 req-a81f08c9-fcdd-48f8-a2ef-d240f844574c service nova] Creating event network-changed:49866aa9-a434-48a8-b590-26fa09814985 for instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd on hv-cinder-86160 Oct 17 17:59:06.754015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-e3ffceab-b0b5-4453-9bcd-da8f9525e732 req-a81f08c9-fcdd-48f8-a2ef-d240f844574c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037234 Oct 17 17:59:06.754841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 185/379] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:07.346396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:07.347147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:07.353503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.354014 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.354552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.355252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.355700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.356116 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.567738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:07.579371 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:07.584860 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:07.584989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-28781b43-098f-45f2-bd28-f376d184797b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1465 microversion: 2.1 time: 0.240610 Oct 17 17:59:07.584989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 195/380] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:07 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1465 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:07.586959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.587674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.588273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.589012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.589634 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.590397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.599601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:07.600451 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:07.633720 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.634367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.634813 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.635538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.637900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.638351 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.776386 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:07.784889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-157390a0-54dc-4dba-a94b-80a5166c8704 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1200 microversion: 2.1 time: 0.197509 Oct 17 17:59:07.785704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 196/381] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:07 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1200 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:07.790344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:07.790974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:07.803818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.804943 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.805388 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.806168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:07.806739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:07.807225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:07.836941 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 17:59:07.861482 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:07.872292 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:07.873897 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:07.875088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3b29d4d7-0cc3-44b8-b103-1489d0f4443b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.300344 Oct 17 17:59:07.875659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 186/382] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:07 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:08.170504 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9f02b139-7601-4a29-a4f9-18b2c3f8fd0b tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 204 len: 0 microversion: 2.1 time: 0.383482 Oct 17 17:59:08.171665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 197/383] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 17:59:07 2022] DELETE /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 17:59:08.179820 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:08.180661 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:08.187475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:08.187966 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:08.188407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:08.189141 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:08.189599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:08.190045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:08.318978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:08.326701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-834626f6-68cd-4167-8185-aaae6c5975f7 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1471 microversion: 2.1 time: 0.150994 Oct 17 17:59:08.328283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 187/384] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:08 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:08.809520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:08.810209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:08.817167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:08.817640 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:08.818065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:08.818740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:08.819233 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:08.819669 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:08.888046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:08.895827 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e028cc65-9f85-43d2-a117-0da3d997b0b3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1210 microversion: 2.1 time: 0.090533 Oct 17 17:59:08.896390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 198/385] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:08 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:08.901975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:08.902613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:08.909150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:08.909626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:08.910062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:08.910772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:08.911229 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:08.911649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:09.042328 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:09.051984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:09.053711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:09.054842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-521fef6d-228a-4297-af27-f698c3367dec tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.156832 Oct 17 17:59:09.055397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 188/386] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:08 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:09.350960 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:09.351565 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:09.357406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:09.357944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:09.358823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:09.359511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:09.359959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:09.360381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:09.364578 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:09.488649 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:09.496099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0d8b53fb-043d-467e-8cfa-ef5f5ec26284 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1471 microversion: 2.1 time: 0.148920 Oct 17 17:59:09.496689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 199/387] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:09 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:09.920996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:09.921616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:09.928080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:09.928847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:09.929391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:09.930085 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:09.930547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:09.930978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:09.995280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:10.003848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b380de8e-4930-49d7-b5fc-c095e34bfc27 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1210 microversion: 2.1 time: 0.086714 Oct 17 17:59:10.004407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 189/388] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:09 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:10.081022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:10.081600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:10.087678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:10.088158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:10.088619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:10.089354 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:10.089806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:10.090225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:10.216149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:10.225273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:10.226699 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:10.227846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-bfb5bb95-8614-475d-a2e3-bf57e4ca3694 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.151908 Oct 17 17:59:10.228391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 200/389] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:10 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:10.518981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:10.519611 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:10.525944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:10.526432 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:10.527262 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:10.527768 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:10.528508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:10.528663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:10.752174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:10.759973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2f1283c6-8513-46cd-821d-d11c6d89bd6e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1471 microversion: 2.1 time: 0.244819 Oct 17 17:59:10.760548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 190/390] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:10 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:11.027782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:11.028454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:11.035203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:11.035687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:11.036155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:11.036879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:11.037333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:11.037752 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:11.107376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:11.115204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-14a03bad-de27-48e9-9cba-35a92f4808e5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1210 microversion: 2.1 time: 0.091393 Oct 17 17:59:11.116042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 201/391] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:11 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:11.254266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:11.254914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:11.258302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:11.259429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:11.263431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:11.265156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:11.265156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:11.265156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:11.265485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:11.265909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:11.457653 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:11.474435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:11.476270 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:11.477633 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-347befd1-4a32-45e2-81ec-9c0724274902 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.228026 Oct 17 17:59:11.478697 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 191/392] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:11 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:11.783930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:11.784523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:11.786492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:11.791211 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:11.791680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:11.792100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:11.792875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:11.793318 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:11.793774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:11.924993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:11.932954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-17b10376-bb1f-4ff5-a8f6-30a659c0d8ea tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1471 microversion: 2.1 time: 0.153584 Oct 17 17:59:11.933518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 202/393] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:11 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:12.138500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:12.139014 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:12.145652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:12.146120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:12.146547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:12.147262 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:12.147809 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:12.148230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:12.280071 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:12.288520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c6bca472-b103-4b5e-b440-8b09b72f8f79 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1277 microversion: 2.1 time: 0.154004 Oct 17 17:59:12.289115 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 192/394] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:12 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:12.504175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:12.505668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:12.511871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:12.512346 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:12.512806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:12.513509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:12.513949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:12.514367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:12.820146 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:12.829712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:12.831141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:12.832772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b5f4c565-a30f-4719-840a-773b5270da2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.332958 Oct 17 17:59:12.850493 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 203/395] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:12 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:12.958628 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:12.962243 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:12.966523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:12.967288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:12.967906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:12.969005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:12.970235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:12.971526 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:13.187593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:13.198740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4083c8a8-5e4a-4d68-8a1d-62d3e8abf9d0 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1471 microversion: 2.1 time: 0.244867 Oct 17 17:59:13.200499 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 193/396] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:12 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:13.316170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:13.317148 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:13.326787 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:13.327546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:13.328132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:13.329619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:13.330283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:13.330872 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:13.576465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:13.584121 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6ff427aa-5792-4dc7-a25c-8786e8e543a5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1277 microversion: 2.1 time: 0.276571 Oct 17 17:59:13.588713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 204/397] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:13 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:13.733466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-9a98b061-0427-4b75-91d3-47bc37f18438 req-90246085-294f-4b17-9f2e-71fbec5a1073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cad671-1640-450b-86cb-0edf44cf2621", "name": "network-vif-deleted", "tag": "adaf3359-ca21-4df6-9e27-e04057411a0e"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:13.745792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-9a98b061-0427-4b75-91d3-47bc37f18438 req-90246085-294f-4b17-9f2e-71fbec5a1073 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:13.746276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-9a98b061-0427-4b75-91d3-47bc37f18438 req-90246085-294f-4b17-9f2e-71fbec5a1073 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:13.746741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-9a98b061-0427-4b75-91d3-47bc37f18438 req-90246085-294f-4b17-9f2e-71fbec5a1073 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:13.767568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-9a98b061-0427-4b75-91d3-47bc37f18438 req-90246085-294f-4b17-9f2e-71fbec5a1073 service nova] Creating event network-vif-deleted:adaf3359-ca21-4df6-9e27-e04057411a0e for instance 33cad671-1640-450b-86cb-0edf44cf2621 on hv-cinder-86160 Oct 17 17:59:13.772647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-9a98b061-0427-4b75-91d3-47bc37f18438 req-90246085-294f-4b17-9f2e-71fbec5a1073 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043737 Oct 17 17:59:13.773568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 194/398] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:13.796028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-a8cf9d65-22df-460f-baef-f56d98c813e1 req-b1402eba-dc30-4047-ab69-c75f57c7dbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aed4c63-5f40-4c41-b922-937d81e91fab", "tag": "23346adb-7974-40d2-8c58-f9c6a1e063fa"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:13.814230 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a8cf9d65-22df-460f-baef-f56d98c813e1 req-b1402eba-dc30-4047-ab69-c75f57c7dbf6 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:13.815871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a8cf9d65-22df-460f-baef-f56d98c813e1 req-b1402eba-dc30-4047-ab69-c75f57c7dbf6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:13.816306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a8cf9d65-22df-460f-baef-f56d98c813e1 req-b1402eba-dc30-4047-ab69-c75f57c7dbf6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:13.838048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-a8cf9d65-22df-460f-baef-f56d98c813e1 req-b1402eba-dc30-4047-ab69-c75f57c7dbf6 service nova] Creating event network-changed:23346adb-7974-40d2-8c58-f9c6a1e063fa for instance 0aed4c63-5f40-4c41-b922-937d81e91fab on hv-cinder-86160 Oct 17 17:59:13.846015 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-a8cf9d65-22df-460f-baef-f56d98c813e1 req-b1402eba-dc30-4047-ab69-c75f57c7dbf6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053292 Oct 17 17:59:13.847954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 205/399] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:13.866023 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:13.867016 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:13.874038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:13.877537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:13.877537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:13.877537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:13.877537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:13.877876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:14.056931 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:14.067473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:14.068960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:14.070752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a1931b4d-11d5-43cb-a7aa-99c96d315382 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.215669 Oct 17 17:59:14.070958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 195/400] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:13 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:14.227574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:14.228676 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:14.234738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:14.239539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:14.239539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:14.239539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:14.239539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:14.239855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:14.272228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:14.272737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:14.273166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:14.273605 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lazy-loading 'fault' on Instance uuid 33cad671-1640-450b-86cb-0edf44cf2621 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:14.330537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:14.338510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5586c666-0701-4149-95d8-7c7d8cd8724e tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1305 microversion: 2.1 time: 0.115392 Oct 17 17:59:14.339071 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 206/401] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:14 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:14.608100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:14.608791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:14.615359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:14.615827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:14.616262 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:14.616967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:14.617416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:14.617836 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:14.747661 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:14.756156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-258d356c-e74d-4537-80ca-fa37bf9f44c5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1277 microversion: 2.1 time: 0.152049 Oct 17 17:59:14.756735 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 196/402] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:14 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:15.097483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:15.098081 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:15.104156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.104661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.105089 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.105771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.106217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.106685 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.236810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:15.245418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:15.246853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:15.247997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b6370fbf-26aa-48bc-af67-c7f9c1070f03 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.155155 Oct 17 17:59:15.248552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 207/403] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:15 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:15.362090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:15.362620 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:15.368505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.369008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.369447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.370131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.370584 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.371006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.401842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.402325 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.402756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.403195 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lazy-loading 'fault' on Instance uuid 33cad671-1640-450b-86cb-0edf44cf2621 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:15.456490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:15.464295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4bef3eb0-f6dd-4fa7-9106-fc0538c66dd6 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1305 microversion: 2.1 time: 0.106146 Oct 17 17:59:15.464887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 197/404] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:15 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:15.778664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:15.779262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:15.785538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.786038 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.786464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.787134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:15.787640 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:15.788055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:15.918540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:15.926430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4abbff69-8e58-4bd0-910c-51c0637077d0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1277 microversion: 2.1 time: 0.151544 Oct 17 17:59:15.927004 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 208/405] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:15 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:16.273497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:16.274106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:16.280497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.281025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.281443 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:16.282215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.282676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.283110 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:16.412464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:16.420907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:16.422484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:16.424754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-61e90206-b703-4b74-8e2f-71e02656680c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.155229 Oct 17 17:59:16.425313 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 198/406] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:16 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:16.490751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:16.490751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:16.495325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.495998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.496430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:16.497145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.497590 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.498010 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:16.531013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.531446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.532514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:16.532848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lazy-loading 'fault' on Instance uuid 33cad671-1640-450b-86cb-0edf44cf2621 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:16.572649 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:16.580149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7cb2b4ae-d6ca-4774-9fa5-40cae039c3ef tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1305 microversion: 2.1 time: 0.095976 Oct 17 17:59:16.580782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 209/407] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:16 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:16.950079 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:16.950855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:16.957975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.961536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.961536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:16.961536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:16.961536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:16.961974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:17.135868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:17.144372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b7351867-3481-4b7d-9447-e69fd2287c80 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1277 microversion: 2.1 time: 0.197982 Oct 17 17:59:17.144965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 199/408] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:16 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:17.450602 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:17.451310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:17.458195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:17.458732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:17.459171 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:17.459975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:17.460386 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:17.460823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:17.603095 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:17.604072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:17.610575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:17.611656 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:17.612630 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:17.615332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:17.615332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:17.615332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:17.661093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:17.661787 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:17.662127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:17.662638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lazy-loading 'fault' on Instance uuid 33cad671-1640-450b-86cb-0edf44cf2621 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:17.686369 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:17.696225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:17.698506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:17.699683 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9212ae0b-ea81-4d72-ad76-2022cdc49ca6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1754 microversion: 2.20 time: 0.252992 Oct 17 17:59:17.700232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 210/409] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:17 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1754 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:17.718233 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:17.728333 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c6f5c296-2123-440e-9fab-6bd5fc6fc741 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1305 microversion: 2.1 time: 0.129165 Oct 17 17:59:17.729710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 200/410] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:17 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:18.167403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:18.167999 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:18.174511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.174992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.175417 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.176151 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.176625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.177201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.321033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:18.329288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8cb202ef-c5b0-42d8-96d6-6d276d0ef817 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1277 microversion: 2.1 time: 0.165603 Oct 17 17:59:18.329899 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 211/411] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:18 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:18.726232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:18.726844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:18.733211 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.733695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.734131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.734820 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.735274 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.736357 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.752774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:18.753374 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:18.761136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.761797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.762228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.763189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.763801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.766569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.818679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:18.831292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:18.831292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:18.831292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lazy-loading 'fault' on Instance uuid 33cad671-1640-450b-86cb-0edf44cf2621 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:18.892002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb4aa732c95c42929fa975d5d389ce78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523bb17ba81d4ce1a7b86807b9c1b13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:18.901931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-98a6131e-99cf-4b51-85f4-70e5b867797f tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 200 len: 1305 microversion: 2.1 time: 0.153206 Oct 17 17:59:18.902510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 212/412] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:18 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 1305 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:18.908091 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:18.911986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:18.917535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:18.918975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:18.920131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7a801b40-f461-4005-a99d-1293bfbc5d4e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.197868 Oct 17 17:59:18.920882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 201/413] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:18 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:19.351273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:19.351878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:19.357726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:19.358195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:19.358617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:19.359294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:19.359736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:19.360151 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:19.520136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:19.527703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b93306fe-f997-42ff-a45b-9c5e3c61075c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.180240 Oct 17 17:59:19.528624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 213/414] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:19 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:19.926666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:19.927207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] [instance: 33cad671-1640-450b-86cb-0edf44cf2621] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:19.934138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:19.937549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:19.937549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:19.937549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:19.937549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:19.937977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:19.947463 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:19.948101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:19.949809 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] HTTP exception thrown: Instance 33cad671-1640-450b-86cb-0edf44cf2621 could not be found. Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Request method failure captured: Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 HTTP/1.1 Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZfAbyv9OPpFyhetnAp2OutaHnIRPyru-FkTX0p1Qws1Ac10LQaA9WzaItvxq8iLSTsULVsiynexOByC8F7kwAQwbb2FPhY9z3bBhSjFX_z2lwBDVL1yP955A9ZC2ZCUvm13m4QeMG3RrO0YiWDKLL10JUrW8EDgXb6z6uBeIoBjxF0 Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 523bb17ba81d4ce1a7b86807b9c1b13b Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesNegativeTest-806557040 Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:59:19.951456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/523bb17ba81d4ce1a7b86807b9c1b13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_523bb17ba81d4ce1a7b86807b9c1b13b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/523bb17ba81d4ce1a7b86807b9c1b13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/523bb17ba81d4ce1a7b86807b9c1b13b"}]}] Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesNegativeTest-806557040 Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 523bb17ba81d4ce1a7b86807b9c1b13b Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesNegativeTest-806557040 Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesNegativeTest-806557040-project Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: eb4aa732c95c42929fa975d5d389ce78 Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesNegativeTest-806557040-project Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 33cad671-1640-450b-86cb-0edf44cf2621 could not be found. Oct 17 17:59:19.956505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '33cad671-1640-450b-86cb-0edf44cf2621'} Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cad671-1640-450b-86cb-0edf44cf2621 could not be found. Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:59:19.957307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cad671-1640-450b-86cb-0edf44cf2621 could not be found. Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cad671-1640-450b-86cb-0edf44cf2621 could not be found. Oct 17 17:59:19.958510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:19.959581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] Returning 404 to user: Instance 33cad671-1640-450b-86cb-0edf44cf2621 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:59:19.959581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-edcb49e7-72d2-40cd-a0fa-9583ebb2bc55 tempest-VolumesNegativeTest-806557040 tempest-VolumesNegativeTest-806557040-project] 10.222.0.58 "GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621" status: 404 len: 111 microversion: 2.1 time: 0.030743 Oct 17 17:59:19.959581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 202/415] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:19 2022] GET /compute/v2.1/servers/33cad671-1640-450b-86cb-0edf44cf2621 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:59:19.959800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:19.959800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:19.959800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:19.959800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:19.960070 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:19.960070 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:20.097969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:20.106519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:20.107952 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:20.109132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-99d54028-1ef6-44bb-a89e-30c45cb84a80 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.165733 Oct 17 17:59:20.109693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 214/416] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:19 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:20.552182 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:20.552847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:20.559199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:20.559644 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:20.560068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:20.560785 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:20.561236 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:20.561660 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:20.692200 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:20.699914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c7028191-088a-4b96-954f-0a685165e36e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.152571 Oct 17 17:59:20.700469 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 203/417] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:20 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:21.134707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:21.135217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:21.141182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:21.141663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:21.142921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:21.143636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:21.144085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:21.144511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:21.163303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:21.281454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:21.291063 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:21.292439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:21.293608 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-956301b6-c240-4ace-bae4-30baa7360280 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.162898 Oct 17 17:59:21.294156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 215/418] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:21 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:21.722720 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:21.723379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:21.730127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:21.730675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:21.731105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:21.731837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:21.732313 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:21.732773 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:21.867491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:21.875886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2a6f179b-c2bf-42b6-b47a-8d877aa469f7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.157200 Oct 17 17:59:21.877023 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 204/419] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:21 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:22.319710 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:22.320374 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:22.326474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:22.326949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:22.327379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:22.328052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:22.328495 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:22.328936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:22.467142 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:22.477750 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:22.479248 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:22.480400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-dd2bde57-f78d-4930-ba22-2bbadcea11af tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.164596 Oct 17 17:59:22.481059 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 216/420] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:22 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:22.899218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:22.899882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:22.913317 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:22.913807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:22.914235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:22.914934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:22.915580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:22.915987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:23.133955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:23.143130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-edd741af-b7bf-42ec-a3da-3d937af0ce8b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.247791 Oct 17 17:59:23.144134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 205/421] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:22 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:23.508743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:23.509342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:23.515475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:23.515954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:23.516382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:23.517596 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:23.518041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:23.518458 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:23.659792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:23.668829 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:23.670247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:23.671381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b01d51ee-c475-468c-b73c-272f32ee67fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.166855 Oct 17 17:59:23.671929 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 217/422] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:23 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:24.165999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:24.166642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:24.173146 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:24.173622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:24.174286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:24.175100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:24.175550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:24.175975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:24.319375 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:24.327445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f017bd64-a883-4b37-a41d-ad7bf9d584a3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.165193 Oct 17 17:59:24.328029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 206/423] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:24 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:24.697290 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:24.697912 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:24.703726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:24.704208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:24.704666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:24.705352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:24.705808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:24.706227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:24.836327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:24.844904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:24.846853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:24.848073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-861622e8-5be2-4021-bbb3-c14a66fe98eb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.154845 Oct 17 17:59:24.848680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 218/424] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:24 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:25.350874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:25.351451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:25.357965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:25.358445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:25.358912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:25.359608 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:25.360066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:25.360493 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:25.501000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:25.510012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d6950c7d-6e48-4173-ad79-85a435c40a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.163812 Oct 17 17:59:25.512002 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 207/425] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:25 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:25.874387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:25.874987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:25.881177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:25.881655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:25.882085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:25.882770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:25.883237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:25.883636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:26.014489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:26.023585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:26.025055 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:26.026269 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8738bb5e-ade5-4b3d-91af-324a93dace46 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.155815 Oct 17 17:59:26.026891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 219/426] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:25 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:26.538949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:26.539656 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:26.546346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:26.551309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:26.551309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:26.551309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:26.551309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:26.551990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:26.709450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:26.718344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1558ecf9-9558-4496-a631-fe803a91d20a tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.183176 Oct 17 17:59:26.720239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 208/427] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:26 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:27.054631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:27.055355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:27.061735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:27.062216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:27.062645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:27.063592 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:27.063951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:27.064457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:27.217282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:27.235490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:27.237527 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:27.238737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ac446657-e7c7-4080-8ab4-09594fc860c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.190431 Oct 17 17:59:27.239499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 220/428] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:27 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:27.745372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:27.745990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:27.753572 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:27.754136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:27.754488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:27.755448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:27.755918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:27.756325 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:27.930485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:27.945528 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-944d858e-5559-43ad-bfa8-5f814abb12f2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.203857 Oct 17 17:59:27.946395 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 209/429] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:27 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:28.265151 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:28.265782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:28.276539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:28.277061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:28.277496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:28.278198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:28.278826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:28.279422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:28.475834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:28.492025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:28.493655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:28.494894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e3d39655-ddf7-4937-8cf4-f2f1f0b60950 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.233888 Oct 17 17:59:28.507915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 221/430] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:28 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:28.972489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:28.973810 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:28.981463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:28.981987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:28.982419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:28.983885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:28.984350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:28.984826 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:29.136145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:29.145474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-824d8b84-28ed-40e5-a481-8e53428d74bc tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.179276 Oct 17 17:59:29.147728 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 210/431] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:28 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:29.522866 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:29.528742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:29.532250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:29.545341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:29.545792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:29.546537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:29.546994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:29.547422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:29.710558 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:29.719858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:29.723123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:29.724490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-158a542a-a628-4053-829b-166ea0e6d3a6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.205533 Oct 17 17:59:29.725083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 222/432] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:29 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:30.171440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:30.172064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:30.178823 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:30.179295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:30.179723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:30.180394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:30.180909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:30.181945 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:30.360156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:30.370510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7d1cc51b-55dd-4570-83a3-c9ff7e6b91dd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.202863 Oct 17 17:59:30.371150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 211/433] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:30 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:30.656511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:30.657342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:30.664155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:30.664761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:30.665186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:30.665878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:30.666321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:30.666734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:30.755158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:30.755938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:30.762871 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:30.763491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:30.763939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:30.764739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:30.765266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:30.765749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:30.831912 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lazy-loading 'services' on Instance uuid 707b0a09-7cd8-4076-8b97-f95d51716d88 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:30.940868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:30.952470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:30.954209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:30.955988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d84d1911-2320-42f6-8161-5b0516fac046 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.208011 Oct 17 17:59:30.956883 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 212/434] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:30 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:31.138080 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2fa4acab-3247-48aa-bd58-9aabaaebce57 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "DELETE /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88/os-volume_attachments/d8e2759c-817d-42bd-bb61-a883e9633f51" status: 202 len: 0 microversion: 2.1 time: 0.485310 Oct 17 17:59:31.138594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 223/435] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 17:59:30 2022] DELETE /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88/os-volume_attachments/d8e2759c-817d-42bd-bb61-a883e9633f51 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 17:59:31.396715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:31.397686 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:31.404411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:31.404922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:31.405352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:31.406042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:31.406489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:31.406909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:31.556367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:31.569480 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7a0313b2-7554-43a9-ab71-8307d98eddb1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.178087 Oct 17 17:59:31.570163 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 213/436] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:31 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:31.983934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:32.036520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:32.036520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:32.036520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:32.036520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:32.036951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:32.036951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:32.036951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:32.166414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:32.175258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:32.176792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:32.177937 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7219d89c-a056-4651-b976-a99301a2c7ff tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.198275 Oct 17 17:59:32.178487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 224/437] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:31 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:32.599658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:32.600377 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:32.608545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:32.609229 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:32.609814 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:32.610626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:32.611234 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:32.611731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:32.753318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:32.761834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b0e72717-ff51-428f-9880-ea5c25242ce8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.172884 Oct 17 17:59:32.762714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 214/438] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:32 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:33.207951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:33.208675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:33.214997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:33.215507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:33.215944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:33.216663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:33.217112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:33.217537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:33.388062 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:33.412352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:33.412352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:33.412352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-37a8fb09-9a7e-4b7c-961e-5776c73f4c2e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.197179 Oct 17 17:59:33.412871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 225/439] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:33 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:33.786114 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:33.786705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:33.793143 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:33.793619 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:33.794050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:33.794740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:33.795191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:33.795610 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:33.928051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:33.936839 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f3b7c16e-3ac6-4ea1-aa77-c76273bb99fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.155138 Oct 17 17:59:33.937534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 215/440] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:33 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:34.426716 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:34.427318 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:34.434098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:34.434906 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:34.435555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:34.436483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:34.437167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:34.437807 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:34.592252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:34.602389 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:34.603802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:34.605027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b6db5249-76e1-4736-8545-2c676a9889fa tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.182650 Oct 17 17:59:34.605582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 226/441] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:34 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:34.962488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:34.963260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:34.965727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=75 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:34.973664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:34.974791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:34.975421 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:34.976396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:34.977100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:34.977863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:35.122495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:35.130362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-902d32d9-934f-46e8-92b7-eeec1c3f12ee tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.172134 Oct 17 17:59:35.130927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 216/442] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:34 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:35.631057 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:35.631645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:35.633655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:35.638207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:35.638714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:35.639144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:35.639813 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:35.640375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:35.640823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:35.772125 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:35.780765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:35.782213 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:35.783359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-80983977-344a-4de6-82a9-2580b6419043 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.156356 Oct 17 17:59:35.784509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 227/443] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:35 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:36.153678 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:36.154267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:36.161226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:36.161698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:36.162153 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:36.162830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:36.163281 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:36.163691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:36.293484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:36.301781 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ace664ac-2ee2-491d-bf53-a05dab22be1b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.152080 Oct 17 17:59:36.303575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 217/444] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:36 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:36.809693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:36.810528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:36.817539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:36.818090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:36.818601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:36.819353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:36.819863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:36.820347 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:36.953093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:36.962522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:36.963964 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:36.965184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9ddb545f-ba00-4a52-a60f-64636638c4f0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.159343 Oct 17 17:59:36.965746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 228/445] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:36 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:37.324981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:37.325589 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:37.331979 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:37.337416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:37.337416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:37.337416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:37.337416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:37.337874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:37.705755 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:37.713006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ce9a5a79-4e2f-4b66-a27a-e7a556be20c8 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.391961 Oct 17 17:59:37.713571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 218/446] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:37 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:37.990490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:37.991092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:37.997042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:37.997515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:37.997947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:37.998627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:37.999074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:37.999492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:38.126154 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:38.135251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:38.139910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:38.139910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-79d14fc8-f5de-4896-81bb-8789a3feda26 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.151274 Oct 17 17:59:38.139910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 229/447] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:37 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:38.735282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:38.735910 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:38.743466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:38.743944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:38.744369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:38.745090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:38.745531 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:38.745948 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:38.749752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:38.883175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:38.890817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b638bef9-4905-4907-936c-502b3c2e51da tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.159444 Oct 17 17:59:38.891387 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 219/448] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:38 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:39.164849 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:39.165448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:39.171259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:39.171737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:39.172163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:39.172864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:39.173314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:39.173732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:39.308390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:39.325011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:39.325011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:39.325011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d28750e1-b21c-47f6-9d1c-9538122c96d7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.159834 Oct 17 17:59:39.325306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 230/449] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:39 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:39.913505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:39.914103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:39.920441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:39.920918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:39.921345 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:39.922027 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:39.922474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:39.922894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:40.086974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:40.094799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-838bb4e9-6662-4f5c-a8e9-f83162002baa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.185194 Oct 17 17:59:40.095368 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 220/450] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:39 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:40.345190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:40.345793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:40.352484 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:40.352989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:40.353414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:40.354094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:40.354541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:40.354959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:40.374512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:40.487567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:40.495787 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:40.497319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:40.498520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-15c7ea2c-4e23-4a4d-b314-09412b834c59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.157163 Oct 17 17:59:40.499089 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 231/451] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:40 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:41.118225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:41.118834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:41.125294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:41.125770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:41.126209 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:41.126885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:41.127337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:41.127759 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:41.261599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:41.269304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6071a51f-3156-4c0e-b34b-4f50b880e29b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.155003 Oct 17 17:59:41.270580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 221/452] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:41 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:41.524430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:41.524978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:41.530944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:41.531421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:41.531846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:41.532517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:41.532986 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:41.533406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:41.661372 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:41.669681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:41.671155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:41.672286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a88c0e9b-cd86-4476-ae39-c1c109c4f5c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.151831 Oct 17 17:59:41.672874 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 232/453] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:41 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:42.292797 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:42.293419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:42.299691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:42.300162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:42.300613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:42.302362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:42.302817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:42.303240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:42.435952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:42.443913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c0c6079a-228b-4562-8d8d-9cdc9180d501 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.155011 Oct 17 17:59:42.444490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 222/454] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:42 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:42.698376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:42.699044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:42.704921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:42.705399 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:42.705838 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:42.706511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:42.706956 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:42.707961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:42.835328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:42.843955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:42.847001 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:42.847001 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-bda5a5bd-8255-4990-8f2a-bf150ccc5154 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.152066 Oct 17 17:59:42.847409 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 233/455] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:42 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:43.467177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:43.467830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:43.474591 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:43.475067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:43.475494 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:43.476172 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:43.476641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:43.477060 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:43.606093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:43.614628 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-73e081c0-3c29-4a82-9e24-73657c0daaa2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.151166 Oct 17 17:59:43.615214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 223/456] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:43 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:43.872471 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:43.873024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:43.879217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:43.879796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:43.880236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:43.880990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:43.881437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:43.881857 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:44.026062 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:44.034588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:44.041017 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:44.041017 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6fdfc509-eae9-4cf2-95fb-3a6ba39bfef5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.169518 Oct 17 17:59:44.041017 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 234/457] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:43 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:44.637474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:44.638075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:44.644376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:44.645872 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:44.646304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:44.646984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:44.647431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:44.647850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:44.775454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:44.783039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-34796424-3678-4154-8e60-768a624b6afb tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.149616 Oct 17 17:59:44.783609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 224/458] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:44 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:45.063217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:45.063818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:45.071023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:45.071506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:45.071940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:45.072727 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:45.073179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:45.078663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:45.205097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:45.213739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:45.215165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:45.216406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1b984457-0047-4eb2-8f0d-e732b7be452c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.157064 Oct 17 17:59:45.217320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 235/459] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:45 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:45.807576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:45.808204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:45.814557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:45.815033 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:45.815460 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:45.816137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:45.817161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:45.817600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:45.953087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:45.961352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-51235a9b-e385-4261-8e98-b810fa346dc4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.157874 Oct 17 17:59:45.961906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 225/460] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:45 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:46.242514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:46.243110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:46.248981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:46.249465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:46.249894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:46.250634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:46.251082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:46.251499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:46.383879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:46.392476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:46.393942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:46.395857 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c4ef8b3e-d632-4440-959e-0d77de3fe536 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.157205 Oct 17 17:59:46.396422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 236/461] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:46 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:46.984496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:46.985138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:46.992174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:46.992689 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:46.993121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:46.993803 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:46.994248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:46.994666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:47.123536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:47.131080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d6a1ceb0-c829-45ee-9cf6-cc454b6bbc32 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.150439 Oct 17 17:59:47.131758 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 226/462] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:46 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:47.420705 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:47.421310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:47.428438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:47.429200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:47.429627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:47.430307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:47.430744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:47.431155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:47.560915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:47.569979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:47.571388 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:47.572514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1da80d4d-ae2b-4c0f-a56a-449ed80a9d1e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.155710 Oct 17 17:59:47.573365 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 237/463] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:47 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:48.153905 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:48.154508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:48.161351 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:48.161835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:48.162402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:48.163107 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:48.163561 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:48.163983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:48.323631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:48.332009 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-05443ebe-ebc1-41cc-8cfc-d1181d2f53d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.181922 Oct 17 17:59:48.354485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 227/464] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:48 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:48.600963 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:48.601545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:48.607459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:48.607931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:48.608356 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:48.609054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:48.609503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:48.609914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:48.739483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:48.749464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:48.750898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:48.752041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5515b38d-92e2-4520-b0b0-5c2e439ed50c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.156097 Oct 17 17:59:48.752726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 238/465] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:48 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:49.281026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:49.281543 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:49.287837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.288313 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.288779 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.289466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.289917 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.290338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.314794 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 17:59:49.355406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:49.356039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:49.361939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.362418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.362846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.363526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.363971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.364385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.498552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:49.507342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e9640808-d32f-49e0-8699-7ec6dcada9b7 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.154712 Oct 17 17:59:49.507985 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 239/466] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:49 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:49.587201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4eb31eb6-1a43-412a-aebd-fdf59a331e49 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "DELETE /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 204 len: 0 microversion: 2.1 time: 0.309653 Oct 17 17:59:49.587790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 228/467] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 17:59:49 2022] DELETE /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 17:59:49.595881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:49.601831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:49.603865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.604379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.604848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.605572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.606129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.606553 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.734496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:49.742100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cf8c198c-2a7d-4a5b-b186-d0403f8ae2c1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1513 microversion: 2.1 time: 0.150115 Oct 17 17:59:49.742661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 240/468] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:49 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:49.778138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:49.778833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:49.784616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.785106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.788052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.788052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:49.788052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:49.788052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:49.918213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:49.926728 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:49.928207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:49.929761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-44f450bb-10a8-4414-9a6f-35b9c8b53de4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.155823 Oct 17 17:59:49.930316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 229/469] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:49 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:50.267468 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-68d10de0-d2d9-4591-a10a-bd67e7b2a4dd req-223481b9-d6ab-497e-b73d-dcc849e5404d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aed4c63-5f40-4c41-b922-937d81e91fab", "name": "network-vif-plugged", "status": "completed", "tag": "23346adb-7974-40d2-8c58-f9c6a1e063fa"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:50.277426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-68d10de0-d2d9-4591-a10a-bd67e7b2a4dd req-223481b9-d6ab-497e-b73d-dcc849e5404d service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.277893 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-68d10de0-d2d9-4591-a10a-bd67e7b2a4dd req-223481b9-d6ab-497e-b73d-dcc849e5404d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.278429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-68d10de0-d2d9-4591-a10a-bd67e7b2a4dd req-223481b9-d6ab-497e-b73d-dcc849e5404d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.289386 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-68d10de0-d2d9-4591-a10a-bd67e7b2a4dd req-223481b9-d6ab-497e-b73d-dcc849e5404d service nova] Creating event network-vif-plugged:23346adb-7974-40d2-8c58-f9c6a1e063fa for instance 0aed4c63-5f40-4c41-b922-937d81e91fab on hv-cinder-86160 Oct 17 17:59:50.294540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-68d10de0-d2d9-4591-a10a-bd67e7b2a4dd req-223481b9-d6ab-497e-b73d-dcc849e5404d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Oct 17 17:59:50.295134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 241/470] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:59:50.377161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a369f7f3-d599-4e30-98ea-ce459dd3319a"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:50.379621 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:50.387158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.387654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.388078 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.388827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.389282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.389703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.531581 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:50.532202 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:50.538615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.539085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.539623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.540297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.540773 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.541185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.673820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:50.683136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-96c81569-f88a-4cd8-a8ce-d8f1a83d8049 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.155866 Oct 17 17:59:50.683695 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 242/471] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:50 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:50.764486 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:50.765118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:50.770852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.771319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.771768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.772435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.772900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.773311 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.903857 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:50.911478 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-88c44c29-cb8c-4a78-af91-2798bc1ce490 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1513 microversion: 2.1 time: 0.150693 Oct 17 17:59:50.916185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 243/472] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:50 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:50.954517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:50.955123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:50.961329 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.961808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.962239 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:50.962919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:50.963370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:50.963792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:51.094771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:51.103382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:51.104780 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:51.105922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-330245cb-6c5c-426a-acae-c897519a9a9f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.155172 Oct 17 17:59:51.106481 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 244/473] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:50 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:51.706314 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:51.707704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:51.714658 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:51.715136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:51.715729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:51.716669 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:51.717209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:51.717819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:51.994928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:52.002955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a54fa9cc-3f2a-4db8-b898-2d343ca23a3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.300463 Oct 17 17:59:52.003525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 245/474] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:51 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:52.008852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:52.010863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:52.015416 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:52.015897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:52.016328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:52.017262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:52.017865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:52.018294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:52.224488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:52.233452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1aa3764c-ff4d-4303-94e6-b6e6e5841500 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1513 microversion: 2.1 time: 0.228940 Oct 17 17:59:52.238393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 246/475] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:52 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:52.238541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:52.239672 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:52.246737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:52.247144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:52.247567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:52.248244 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:52.248726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:52.249142 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:52.313875 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d1ae0033-adf9-4289-9f30-54193f298cdf tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.940579 Oct 17 17:59:52.314607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 230/476] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 17:59:50 2022] POST /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments => generated 194 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:52.472908 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:52.483546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:52.485147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:52.485635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-f9e4a66a-0069-4f50-9a24-dfb799b8b30c req-10fa3cbc-dff8-4251-987c-a900c893c058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707b0a09-7cd8-4076-8b97-f95d51716d88", "name": "network-vif-deleted", "tag": "1bf643cd-3450-4c5e-810e-ef91a891efc8"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:52.486305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6c2defdd-c92e-4603-aa8b-5c9e19e22135 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.251358 Oct 17 17:59:52.486889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 247/477] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:52 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:52.496447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f9e4a66a-0069-4f50-9a24-dfb799b8b30c req-10fa3cbc-dff8-4251-987c-a900c893c058 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:52.497011 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f9e4a66a-0069-4f50-9a24-dfb799b8b30c req-10fa3cbc-dff8-4251-987c-a900c893c058 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:52.497375 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f9e4a66a-0069-4f50-9a24-dfb799b8b30c req-10fa3cbc-dff8-4251-987c-a900c893c058 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:52.508509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-f9e4a66a-0069-4f50-9a24-dfb799b8b30c req-10fa3cbc-dff8-4251-987c-a900c893c058 service nova] Creating event network-vif-deleted:1bf643cd-3450-4c5e-810e-ef91a891efc8 for instance 707b0a09-7cd8-4076-8b97-f95d51716d88 on hv-cinder-86160 Oct 17 17:59:52.513249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-f9e4a66a-0069-4f50-9a24-dfb799b8b30c req-10fa3cbc-dff8-4251-987c-a900c893c058 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Oct 17 17:59:52.513804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 231/478] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:59:53.027145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:53.027735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:53.033691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.034164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.034666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.035371 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.035818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.036236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.166557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:53.170046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:53.174500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-84ff1b73-5004-4619-9466-b2038d89780d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1265 microversion: 2.1 time: 0.151859 Oct 17 17:59:53.175067 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 248/479] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:53 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:53.258484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:53.259256 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:53.265377 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.265851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.266350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.267037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.267488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.267911 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.332026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:53.339989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-140b1533-6139-4c4d-b305-65993ec2e007 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1304 microversion: 2.1 time: 0.086628 Oct 17 17:59:53.340536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 232/480] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:53 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:53.511934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:53.512531 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:53.518936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.519395 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.519822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.520498 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.521052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.521471 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.581306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:53.581871 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:53.587981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.588436 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.588913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.589607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.590085 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.591870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.608868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 17:59:53.615768 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2d8a8d2b-d573-4e9d-b164-3ba96bc96021 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/ips" status: 200 len: 150 microversion: 2.1 time: 0.038295 Oct 17 17:59:53.616568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 233/481] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 17:59:53 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:53.628932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1970b1d-27d1-411f-9126-0476b528d495"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:53.631346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:53.638100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.638585 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.639009 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.639686 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.640130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.640546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.650441 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:53.659230 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:53.660819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:53.662042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-86569987-0e9c-4725-9723-6533e2a0b852 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.154760 Oct 17 17:59:53.662697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 249/482] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:53 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:53.722805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Invalid volume: volume c1970b1d-27d1-411f-9126-0476b528d495 is already attached to instances: bf4103da-d0cb-4d9c-b475-e0ee08b57398 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: POST /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/os-volume_attachments HTTP/1.1 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 74 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:59:53.724934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {"volumeAttachment": {"volumeId": "c1970b1d-27d1-411f-9126-0476b528d495"}} Oct 17 17:59:53.726579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Invalid volume: volume c1970b1d-27d1-411f-9126-0476b528d495 is already attached to instances: bf4103da-d0cb-4d9c-b475-e0ee08b57398 Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'server_id': '675604a3-eb66-477f-ac4b-e12b1fbbdedd', 'body': {'volumeAttachment': {'volumeId': 'c1970b1d-27d1-411f-9126-0476b528d495'}}} Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c1970b1d-27d1-411f-9126-0476b528d495 is already attached to instances: bf4103da-d0cb-4d9c-b475-e0ee08b57398 Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:53.728224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c1970b1d-27d1-411f-9126-0476b528d495 is already attached to instances: bf4103da-d0cb-4d9c-b475-e0ee08b57398 Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:53.729751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c1970b1d-27d1-411f-9126-0476b528d495 is already attached to instances: bf4103da-d0cb-4d9c-b475-e0ee08b57398 Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 400 to user: Invalid volume: volume c1970b1d-27d1-411f-9126-0476b528d495 is already attached to instances: bf4103da-d0cb-4d9c-b475-e0ee08b57398 {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-52244d3a-caef-4a46-a2aa-af1528dce3ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101507 Oct 17 17:59:53.731260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 234/483] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 17:59:53 2022] POST /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 17:59:53.736013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:53.736507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:53.743089 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.743714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.744142 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.744843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:53.745293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:53.745714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:53.769786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 17:59:54.063754 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-00899330-791b-4f09-98fa-8defdc904478 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 204 len: 0 microversion: 2.1 time: 0.331162 Oct 17 17:59:54.064389 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 250/484] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 17:59:53 2022] DELETE /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 17:59:54.073969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:54.074570 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:54.081156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.081630 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.082059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.082738 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.083185 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.083602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.199876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:54.200567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:54.206404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.206880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.207305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.207988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.208437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.208876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.216264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.224409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-554503e8-814d-4024-8277-bacaab43ff07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1680 microversion: 2.1 time: 0.155782 Oct 17 17:59:54.225008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 235/485] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:54 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:54.342757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.350345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b51117a4-e6c0-4462-8b89-ad3098fb0fc3 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1453 microversion: 2.1 time: 0.154860 Oct 17 17:59:54.350917 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 251/486] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:54 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:54.362948 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:54.363668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:54.372189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.372687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.373434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.373990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:54.374619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:54.374868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.375526 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.376096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.381305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.381998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.382429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.383147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.384469 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.384932 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.411044 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.411637 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.412075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.412520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lazy-loading 'fault' on Instance uuid 707b0a09-7cd8-4076-8b97-f95d51716d88 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:54.480758 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.489180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1c7ec405-33ae-4127-9568-9142000bead8 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1309 microversion: 2.1 time: 0.130130 Oct 17 17:59:54.489757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 236/487] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:54 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:54.566255 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.574430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-29dd1e41-8e59-4015-a3aa-41e180df357b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1453 microversion: 2.1 time: 0.204499 Oct 17 17:59:54.575001 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 252/488] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:54 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 17:59:54.689347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:54.689936 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:54.696494 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.697096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.697602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.698394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:54.698925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:54.699422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:54.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.869573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.871013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:54.872167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-375733b8-cf9e-4d82-a6fc-25788e70c71f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.186771 Oct 17 17:59:54.872750 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 237/489] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:54 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:55.250619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:55.251358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:55.257312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.257789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.258220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:55.259169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.259611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.260033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:55.392406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:55.401253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f5d0751b-0f84-4c84-85a1-322c71271d9a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1680 microversion: 2.1 time: 0.154220 Oct 17 17:59:55.401499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 253/490] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:55 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:55.514253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:55.514784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:55.521226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.521712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.522157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:55.522839 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.523281 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.523892 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:55.562273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.562750 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.563185 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:55.563631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lazy-loading 'fault' on Instance uuid 707b0a09-7cd8-4076-8b97-f95d51716d88 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:55.616074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:55.624616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-02ae2650-b899-40ba-84b0-206c68cfd503 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1309 microversion: 2.1 time: 0.114274 Oct 17 17:59:55.625390 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 238/491] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:55 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:55.898512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:55.899109 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:55.905823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.906431 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.906867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:55.907575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:55.908022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:55.908438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.050232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:56.068967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:56.070398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:56.071651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d56cb8c9-8b4e-4426-a359-2293c774d5e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.177309 Oct 17 17:59:56.072427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 254/492] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:55 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:56.425665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:56.427014 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:56.435077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:56.435642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:56.436260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.437055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:56.437571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:56.438062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.649990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:56.651527 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:56.659345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:56.660979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:56.661764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.663075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:56.663737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:56.664405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.708906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:56.724077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3c07b5fd-5f63-413e-8158-da20f9f71bb6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1680 microversion: 2.1 time: 0.302572 Oct 17 17:59:56.736743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 239/493] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:56 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:56.756141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:56.757559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:56.758296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.760394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lazy-loading 'fault' on Instance uuid 707b0a09-7cd8-4076-8b97-f95d51716d88 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:56.833124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:56.843072 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b872aae1-0fd3-40f9-ab66-2bc971005ad7 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 200 len: 1309 microversion: 2.1 time: 0.198052 Oct 17 17:59:56.846208 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 255/494] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:56 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:56.930744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-369c2e05-138b-4d27-8e19-d27089d3b543 req-0ace457e-65b6-4e86-8f74-d8714347a701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aed4c63-5f40-4c41-b922-937d81e91fab", "tag": "23346adb-7974-40d2-8c58-f9c6a1e063fa"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:56.940576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-369c2e05-138b-4d27-8e19-d27089d3b543 req-0ace457e-65b6-4e86-8f74-d8714347a701 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:56.941140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-369c2e05-138b-4d27-8e19-d27089d3b543 req-0ace457e-65b6-4e86-8f74-d8714347a701 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:56.941606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-369c2e05-138b-4d27-8e19-d27089d3b543 req-0ace457e-65b6-4e86-8f74-d8714347a701 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:56.953756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-369c2e05-138b-4d27-8e19-d27089d3b543 req-0ace457e-65b6-4e86-8f74-d8714347a701 service nova] Creating event network-changed:23346adb-7974-40d2-8c58-f9c6a1e063fa for instance 0aed4c63-5f40-4c41-b922-937d81e91fab on hv-cinder-86160 Oct 17 17:59:56.959151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-369c2e05-138b-4d27-8e19-d27089d3b543 req-0ace457e-65b6-4e86-8f74-d8714347a701 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033468 Oct 17 17:59:56.960125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 240/495] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 17:59:57.097149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:57.098093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:57.108584 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:57.111869 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:57.112542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:57.113531 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:57.115328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:57.115924 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:57.648037 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:57.663185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:57.665370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:57.666774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9c956a4d-729f-4f17-beda-53b345dfe59c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.573486 Oct 17 17:59:57.668284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 256/496] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:57 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 17:59:57.759554 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:57.760179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:57.764350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-df3947b8-87cd-41d4-8f19-b8c6b834c0ab req-4ccc622b-0ebe-4ae2-956c-fa3468a5537d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675604a3-eb66-477f-ac4b-e12b1fbbdedd", "name": "network-vif-deleted", "tag": "49866aa9-a434-48a8-b590-26fa09814985"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:57.773123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:57.773635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:57.775940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:57.777023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:57.777489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:57.779818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:57.784878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-df3947b8-87cd-41d4-8f19-b8c6b834c0ab req-4ccc622b-0ebe-4ae2-956c-fa3468a5537d service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:57.789970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-df3947b8-87cd-41d4-8f19-b8c6b834c0ab req-4ccc622b-0ebe-4ae2-956c-fa3468a5537d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:57.790646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-df3947b8-87cd-41d4-8f19-b8c6b834c0ab req-4ccc622b-0ebe-4ae2-956c-fa3468a5537d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:57.818270 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-df3947b8-87cd-41d4-8f19-b8c6b834c0ab req-4ccc622b-0ebe-4ae2-956c-fa3468a5537d service nova] Creating event network-vif-deleted:49866aa9-a434-48a8-b590-26fa09814985 for instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd on hv-cinder-86160 Oct 17 17:59:57.831762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-df3947b8-87cd-41d4-8f19-b8c6b834c0ab req-4ccc622b-0ebe-4ae2-956c-fa3468a5537d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084160 Oct 17 17:59:57.833402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 241/497] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:59:57.871629 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:57.872708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: 707b0a09-7cd8-4076-8b97-f95d51716d88] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:58.015784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:58.017549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.017549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.017549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:58.017549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.017862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.017862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:58.018016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9cddd3ab-16f2-48da-9f5f-50412bc95c74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1613 microversion: 2.1 time: 0.161321 Oct 17 17:59:58.018016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 257/498] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:57 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1613 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] HTTP exception thrown: Instance 707b0a09-7cd8-4076-8b97-f95d51716d88 could not be found. Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Request method failure captured: Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 HTTP/1.1 Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZejsL0YUJOth34-v205_saW9P0oZ9B5F-k1LP56rURvzsdEdmItcxP1xJAqc2ErczrAHwgTBGGk0So4MeaWIBJVybwul_rwDHU24wZofladD8kJoq8GOGogrGnMlcyhcupBxQfCrQaKy7-AL_dSp9gQqjwpMgB_3xCUUlYdUK5DtCs Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: a83fc47293e042d99a58560f5c847558 Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1597802632 Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 17:59:58.018170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a83fc47293e042d99a58560f5c847558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a83fc47293e042d99a58560f5c847558", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a83fc47293e042d99a58560f5c847558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a83fc47293e042d99a58560f5c847558"}]}] Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesSnapshotTestJSON-1597802632 Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: a83fc47293e042d99a58560f5c847558 Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1597802632 Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesSnapshotTestJSON-1597802632-project Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: c67de166f6bb4a66ae1b70335035a02c Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesSnapshotTestJSON-1597802632-project Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 707b0a09-7cd8-4076-8b97-f95d51716d88 could not be found. Oct 17 17:59:58.019672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '707b0a09-7cd8-4076-8b97-f95d51716d88'} Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707b0a09-7cd8-4076-8b97-f95d51716d88 could not be found. Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 17:59:58.021367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707b0a09-7cd8-4076-8b97-f95d51716d88 could not be found. Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707b0a09-7cd8-4076-8b97-f95d51716d88 could not be found. Oct 17 17:59:58.024519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 17:59:58.028140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Returning 404 to user: Instance 707b0a09-7cd8-4076-8b97-f95d51716d88 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 17:59:58.028140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0f8ea34b-e8c5-4e25-8b1f-3cc3e2cef35d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88" status: 404 len: 111 microversion: 2.1 time: 0.079422 Oct 17 17:59:58.028140 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 242/499] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:57 2022] GET /compute/v2.1/servers/707b0a09-7cd8-4076-8b97-f95d51716d88 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 17:59:58.422473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-8c8b916d-5037-462d-9809-7ab470702cca req-1a7b20c6-b239-459e-b888-a0353c6b2209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "name": "network-vif-plugged", "status": "completed", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 17:59:58.449153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-8c8b916d-5037-462d-9809-7ab470702cca req-1a7b20c6-b239-459e-b888-a0353c6b2209 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.452182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-8c8b916d-5037-462d-9809-7ab470702cca req-1a7b20c6-b239-459e-b888-a0353c6b2209 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.452182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-8c8b916d-5037-462d-9809-7ab470702cca req-1a7b20c6-b239-459e-b888-a0353c6b2209 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:58.468390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-8c8b916d-5037-462d-9809-7ab470702cca req-1a7b20c6-b239-459e-b888-a0353c6b2209 service nova] Creating event network-vif-plugged:159ad1ae-f38b-4dca-afd5-a41b7031cb8c for instance d932b27f-b1fd-42b4-a8e3-3908063839da on hv-cinder-86160 Oct 17 17:59:58.495662 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-8c8b916d-5037-462d-9809-7ab470702cca req-1a7b20c6-b239-459e-b888-a0353c6b2209 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064125 Oct 17 17:59:58.495662 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 258/500] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 17:59:58.696587 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:58.697524 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:58.706146 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.707060 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.707820 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:58.708857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.709655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.710316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:58.916348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:58.926144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:58.927832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:58.929550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a6e77633-eb3c-4c67-bedb-a9ee9ddcd252 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.237524 Oct 17 17:59:58.943161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 243/501] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:58 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 17:59:58.952249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:58.958641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:58.960075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.960563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.961022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:58.961811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:58.962258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:58.962678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:59.005227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:59.005227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:59.005227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:59.005227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid 675604a3-eb66-477f-ac4b-e12b1fbbdedd {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 17:59:59.054440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 17:59:59.063030 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-acb9e235-c44e-46ca-975f-dd11e0b1ad5b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1330 microversion: 2.1 time: 0.114343 Oct 17 17:59:59.063527 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 259/502] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 17:59:58 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 17:59:59.959481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 17:59:59.960083 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 17:59:59.966765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:59.967239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:59.967668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 17:59:59.968353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 17:59:59.968830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 17:59:59.969254 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:00.087890 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:00.088495 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:00.094406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:00.094882 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:00.095316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:00.095994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:00.096437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:00.096877 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:00.100264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:00.109635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:00.111163 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:00.112395 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1daff0d6-e1a8-4347-8f06-b954b8ae6e8f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.156876 Oct 17 18:00:00.113111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 244/503] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 17:59:59 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:00.127678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:00.128145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:00.128569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:00.129026 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid 675604a3-eb66-477f-ac4b-e12b1fbbdedd {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:00.168970 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:00.176406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7d0bf453-e019-466c-a9f7-796257cfc625 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1330 microversion: 2.1 time: 0.093010 Oct 17 18:00:00.176996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 260/504] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:00 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:01.137749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:01.139497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:01.146267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:01.146737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:01.147470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:01.148163 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:01.148631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:01.149567 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:01.199800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:01.200379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:01.206466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:01.206942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:01.207366 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:01.208041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:01.208484 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:01.208941 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:01.240875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:01.241367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:01.241775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:01.242213 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid 675604a3-eb66-477f-ac4b-e12b1fbbdedd {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:01.295340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:01.302860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-152c985a-bcb0-4af4-9c6a-9dd466aa6cda tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1330 microversion: 2.1 time: 0.107474 Oct 17 18:00:01.303423 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 261/505] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:01 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:01.307433 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:01.315807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:01.317266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:01.318425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ad049343-9f30-4d3e-96f3-d596b84c932f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.184652 Oct 17 18:00:01.318951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 245/506] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:01 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:00:02.326914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:02.327428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:02.333318 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:02.333783 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:02.334205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:02.334876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:02.335319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:02.335732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:02.343784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:02.344413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:02.350745 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:02.351231 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:02.351668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:02.352414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:02.353650 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:02.354085 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:02.367852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:02.368575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:02.369054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:02.369500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid 675604a3-eb66-477f-ac4b-e12b1fbbdedd {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:02.434278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:02.438841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:02.443327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ca3a9dd1-c34d-438a-a149-d9a5d2c4bbb2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 200 len: 1330 microversion: 2.1 time: 0.120351 Oct 17 18:00:02.443922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 262/507] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:02 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:02.502056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:02.511238 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:02.512701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:02.513843 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f4f45e87-3924-48cf-80cd-e376d205db62 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.173992 Oct 17 18:00:02.514396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 246/508] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:02 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:00:03.467232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:03.467831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:03.474375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:03.474844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:03.478996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:03.478996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:03.478996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:03.478996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:03.491409 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd HTTP/1.1 Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:00:03.493041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:00:03.495585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '675604a3-eb66-477f-ac4b-e12b1fbbdedd'} Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:00:03.496396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:00:03.497896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:03.499165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:00:03.499165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3625d64c-4283-412f-8077-603377c8ddf6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 404 len: 111 microversion: 2.1 time: 0.031857 Oct 17 18:00:03.499165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 263/509] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:03 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:00:03.504032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-46629235-bbe5-4c7c-97c0-a33db6afaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '.version_select at 0x7f01962eda60>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:03.539206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:03.539749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:03.546725 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:03.547196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:03.547618 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:03.548292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:03.548762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:03.549175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:03.579444 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-46629235-bbe5-4c7c-97c0-a33db6afaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847501047" status: 202 len: 0 microversion: 2.1 time: 0.079024 Oct 17 18:00:03.580061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 247/510] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847501047 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:00:03.698931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:03.708737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:03.710228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:03.711368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-71a8ca45-c15b-4171-8187-cc28dfbc2af0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.176218 Oct 17 18:00:03.712479 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 264/511] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:03 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:00:04.500389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:04.502699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:04.515714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:04.516305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:04.516654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:04.525283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:04.528058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:04.528463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:04.555877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'flavor' on Instance uuid 62268bc4-006f-4d44-a766-5930b2cca957 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:04.740146 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:04.740985 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:04.747587 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:04.748168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:04.748618 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:04.749299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:04.749742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:04.750162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:04.974275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:04.976853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ba6772a2-96a9-44df-b71b-05b31dffee3b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/action" status: 200 len: 32 microversion: 2.1 time: 0.480608 Oct 17 18:00:04.977858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 248/512] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:00:04 2022] POST /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/action => generated 32 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:00:04.984285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:04.986474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:04.988101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d7451868-df25-4c2c-aeff-69c700d20ee0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.252257 Oct 17 18:00:04.988972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:04.989325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 265/513] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:04 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:04.990350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:05.005551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:05.005551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:05.005551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:05.005551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:05.005877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:05.005877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:05.061394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:05.062162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:05.068293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:05.072721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:05.072721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:05.072721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:05.072721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:05.073102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:05.157680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:05.161629 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'services' on Instance uuid bf4103da-d0cb-4d9c-b475-e0ee08b57398 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:05.166406 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1ef7f0a7-451d-4aa2-819f-ef8ecc9171b2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.182192 Oct 17 18:00:05.167016 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 249/514] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:04 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:05.389744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d1d3d53b-f822-48d5-9fdf-9fb92dc1d69a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments/c1970b1d-27d1-411f-9126-0476b528d495" status: 202 len: 0 microversion: 2.1 time: 0.332096 Oct 17 18:00:05.390342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 266/515] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:00:05 2022] DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments/c1970b1d-27d1-411f-9126-0476b528d495 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 18:00:05.398817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:05.401283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:05.403237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:05.408011 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:05.408479 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:05.408944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:05.409646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:05.410126 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:05.410549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:05.437118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:05.442026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-42e6aad9-d4b9-47e8-a382-6ca8f1296771 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047175 Oct 17 18:00:05.442596 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 250/516] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:00:05 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:06.015655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:06.016261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:06.018212 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:06.023030 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:06.023514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:06.023947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:06.024747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:06.025376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:06.025761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:06.154547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:06.162968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:06.164384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:06.166200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cc63380a-77f6-4f17-bb29-2a3251028ae0 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.154392 Oct 17 18:00:06.166871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 267/517] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:06 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:06.190807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:06.191413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:06.198885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:06.199364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:06.199796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:06.200479 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:06.200953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:06.201379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:06.336112 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:06.344516 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7029ae93-d2d7-49a1-a017-953a9a1c0821 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.157803 Oct 17 18:00:06.345112 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 251/518] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:06 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:06.456967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:06.459247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:06.465239 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:06.465722 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:06.466159 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:06.466843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:06.467295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:06.467718 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:06.497483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b4406e83-3969-448d-b66b-e07f9fff7e3a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Oct 17 18:00:06.498044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 268/519] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:00:06 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:00:07.191188 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:07.191791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:07.198952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:07.199428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:07.199865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:07.200549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:07.201019 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:07.201440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:07.334432 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:07.344337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:07.345815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:07.346978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-66d216ef-df47-4066-a19c-4c819f6e1954 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1810 microversion: 2.20 time: 0.159679 Oct 17 18:00:07.347567 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 252/520] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:07 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:07.367176 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:07.367778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:07.373860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:07.374339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:07.374774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:07.375505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:07.375959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:07.376380 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:07.508242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:07.510005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:07.512291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:07.516540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c5a9f0bf-84c2-4714-918e-c5f534a5b822 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.153206 Oct 17 18:00:07.517138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 269/521] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:07 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:07.518221 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:07.518698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:07.519137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:07.519845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:07.520981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:07.521412 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:07.554663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-31180f31-a31f-48f3-93cb-c2cc0f06c752 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048318 Oct 17 18:00:07.555217 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 253/522] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:00:07 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:08.371834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:08.372570 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:08.378514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:08.378988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:08.379414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:08.380095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:08.380540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:08.380988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:08.540081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:08.541483 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:08.548081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:08.548796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:08.549300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:08.550062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:08.550609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:08.551240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:08.584863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:08.595102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:08.596708 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:08.597948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7c9348b1-e2e0-4213-ad0e-81a3f1839854 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1797 microversion: 2.20 time: 0.230025 Oct 17 18:00:08.598766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 270/523] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:08 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1797 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:08.604286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:08.606427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:08.612525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:08.613069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:08.613706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:08.614560 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:08.615167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:08.615745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:08.647340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-46ea6b5b-8cd7-4006-bcaf-2b5a4a314167 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047287 Oct 17 18:00:08.647829 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 271/524] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:00:08 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:08.799696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:08.810253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b1091994-a870-4874-8969-a23016547e95 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.273935 Oct 17 18:00:08.815573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 254/525] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:08 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:08.921218 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1425416993", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "networks": [{"uuid": "46eae69b-b33b-4b1c-8871-d27f67112bbd"}]}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:08.976903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] validate_networks() for [('46eae69b-b33b-4b1c-8871-d27f67112bbd', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:00:09.329480 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:00:09.329891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:00:09.330352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:00:09.330750 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:00:09.331149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:00:09.340436 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.340939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.341386 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.342093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.342565 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.342979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.359851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Getting quotas for project a83fc47293e042d99a58560f5c847558. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:00:09.363762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Getting quotas for user c67de166f6bb4a66ae1b70335035a02c and project a83fc47293e042d99a58560f5c847558. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:00:09.374884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:00:09.377171 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:00:09.517181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-85022c8f-6b6c-475d-8fcb-83691edc67f3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600029 Oct 17 18:00:09.517754 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 272/526] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:00:09.529913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8b9d646f-48fb-45a2-9bfc-9f0713689f41 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:09.530515 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8b9d646f-48fb-45a2-9bfc-9f0713689f41 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:09.590987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8b9d646f-48fb-45a2-9bfc-9f0713689f41 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:09.598177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8b9d646f-48fb-45a2-9bfc-9f0713689f41 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1219 microversion: 2.1 time: 0.073200 Oct 17 18:00:09.598815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 255/527] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:09 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:09.670275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:09.670275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:09.670275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.671020 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.671503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.672197 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.672668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.673086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.704035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-742787b1-e1ef-49bc-bfba-333532595be2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048096 Oct 17 18:00:09.704586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 273/528] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:00:09 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:00:09.767667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:09.767996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:09.774369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.779365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.779365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.779365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.779365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.779769 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.803372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:00:09.833875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:09.834477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:09.841106 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.841585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.842041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.842732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:09.843182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:09.843605 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:09.975588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:09.984703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4ddcf8cb-ed7e-443a-a224-3848d37bc11c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154700 Oct 17 18:00:09.985282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 274/529] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:09 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:10.170021 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2b84acbe-8cda-4433-a441-9512f368e6fb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 204 len: 0 microversion: 2.1 time: 0.406031 Oct 17 18:00:10.170714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 256/530] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:00:09 2022] DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:00:10.178832 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:10.179935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:10.186034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:10.186513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:10.186948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:10.187634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:10.188085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:10.188504 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:10.318916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:10.327136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-239daaeb-a1a9-4a61-b90b-f24d96b83d84 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1683 microversion: 2.1 time: 0.152186 Oct 17 18:00:10.327740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 275/531] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:10 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:10.621951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:10.622563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:10.628992 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:10.629470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:10.629907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:10.630589 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:10.631043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:10.631467 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:10.693342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:10.701088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8fa75e2c-0edd-48d0-bf72-9dcca28307b2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1223 microversion: 2.1 time: 0.083397 Oct 17 18:00:10.701653 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 257/532] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:10 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:11.007207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:11.007810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:11.013938 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:11.014421 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:11.014856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:11.015550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:11.015990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:11.016412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:11.142317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:11.150433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3663ef64-4a80-4120-9730-3db4fb87c13d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.147134 Oct 17 18:00:11.151124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 276/533] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:11 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:11.351139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:11.351751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:11.358784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:11.359259 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:11.359693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:11.360380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:11.360857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:11.361283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:11.488698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:11.496386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8c56e073-9143-46a0-abc8-3386b5a78db9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1683 microversion: 2.1 time: 0.149067 Oct 17 18:00:11.497006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 258/534] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:11 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:11.724386 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:11.724946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:11.731011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:11.731482 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:11.731911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:11.732587 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:11.733060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:11.733477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:11.793059 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:11.800505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1f9dda1d-b4d5-46f7-9c18-cdfa97b1db9c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1223 microversion: 2.1 time: 0.080023 Oct 17 18:00:11.801095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 277/535] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:11 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:12.173580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:12.174193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:12.182338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:12.182866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:12.183333 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:12.184033 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:12.184485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:12.184941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:12.329938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:12.338418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1ec51c03-8b4f-4491-a83e-2c585b73458a tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.168437 Oct 17 18:00:12.339553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 259/536] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:12 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:12.519530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:12.520205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:12.526634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:12.527119 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:12.527561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:12.528255 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:12.528737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:12.529157 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:12.737601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:12.745949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-baf8e1ca-031e-46f3-a057-91461ab4857a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1683 microversion: 2.1 time: 0.230384 Oct 17 18:00:12.765033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 278/537] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:12 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:12.829022 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:12.829022 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:12.839076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:12.841223 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:12.841689 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:12.842419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:12.842882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:12.843304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:12.960089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:12.968375 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b43bf401-d42d-467e-b437-92447a30eff4 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1271 microversion: 2.1 time: 0.148855 Oct 17 18:00:12.969164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 260/538] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:12 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:13.363739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:13.364551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:13.372286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:13.372905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:13.373583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:13.374273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:13.374720 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:13.376303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:13.519597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:13.529586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-195661a5-ae85-41bd-bff0-107fc719eed1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.170934 Oct 17 18:00:13.531852 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-7ca0ad42-321b-4b0e-95d6-2466b3586a7b req-fb6be82a-08b6-453d-84f4-9c8f69117a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4103da-d0cb-4d9c-b475-e0ee08b57398", "name": "network-vif-deleted", "tag": "6f031636-bf67-4c5d-9a2a-708b298712ca"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:13.542255 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 279/539] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:13 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:13.542556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7ca0ad42-321b-4b0e-95d6-2466b3586a7b req-fb6be82a-08b6-453d-84f4-9c8f69117a9b service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:13.543504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7ca0ad42-321b-4b0e-95d6-2466b3586a7b req-fb6be82a-08b6-453d-84f4-9c8f69117a9b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:13.547466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7ca0ad42-321b-4b0e-95d6-2466b3586a7b req-fb6be82a-08b6-453d-84f4-9c8f69117a9b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:13.555648 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-7ca0ad42-321b-4b0e-95d6-2466b3586a7b req-fb6be82a-08b6-453d-84f4-9c8f69117a9b service nova] Creating event network-vif-deleted:6f031636-bf67-4c5d-9a2a-708b298712ca for instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 on hv-cinder-86160 Oct 17 18:00:13.562273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-7ca0ad42-321b-4b0e-95d6-2466b3586a7b req-fb6be82a-08b6-453d-84f4-9c8f69117a9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Oct 17 18:00:13.563311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 261/540] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:00:13.770038 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:13.770977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:13.778411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:13.779102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:13.779645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:13.780690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:13.781391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:13.781934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:13.788630 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:13.848853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:13.859155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-03ff8df1-aa10-4e43-8c78-b309087c6b1d tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1326 microversion: 2.1 time: 0.092925 Oct 17 18:00:13.870312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 280/541] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:13 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:14.000118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:14.000833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:14.007047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.007573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.008000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.008909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.009510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.010405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.085159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:14.093745 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e6e4e492-906a-4080-9439-eba8eeab676c tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1289 microversion: 2.1 time: 0.099309 Oct 17 18:00:14.094742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 262/542] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:13 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:14.553788 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:14.554696 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:14.563601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.564403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.565742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.566138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.567325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.567911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.707121 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:14.719816 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d11c65ec-afe8-4396-b2d2-b8d0e6d906f6 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.170048 Oct 17 18:00:14.739740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 281/543] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:14 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:14.882090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:14.883233 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:14.891007 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.891913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.894173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.894173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.894173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.894173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.928736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:14.929216 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:14.929900 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:14.930347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid bf4103da-d0cb-4d9c-b475-e0ee08b57398 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:14.980382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:14.988498 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-688c3259-0ed5-44dc-9f48-14475cefb405 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 200 len: 1331 microversion: 2.1 time: 0.110394 Oct 17 18:00:14.989210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 263/544] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:14 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:15.118418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:15.118928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:15.125491 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:15.125967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:15.126396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:15.127086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:15.127530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:15.127945 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:15.261360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:15.268953 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1e493b94-bdfa-4e6f-ba3b-6a7d07044d85 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.154455 Oct 17 18:00:15.269515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 282/545] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:15 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:15.646305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-c5528d6f-1bf1-4a2d-a9de-cb78ca70586a req-b1c4649e-e9a8-4df4-91b3-9697ae4b496a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0e4a30-0260-4885-9bc2-75584d349814", "tag": "73003b71-b2fe-446a-9be7-3819b8e8dacb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:15.657462 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c5528d6f-1bf1-4a2d-a9de-cb78ca70586a req-b1c4649e-e9a8-4df4-91b3-9697ae4b496a service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:15.657976 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c5528d6f-1bf1-4a2d-a9de-cb78ca70586a req-b1c4649e-e9a8-4df4-91b3-9697ae4b496a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:15.658396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c5528d6f-1bf1-4a2d-a9de-cb78ca70586a req-b1c4649e-e9a8-4df4-91b3-9697ae4b496a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:15.670998 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-c5528d6f-1bf1-4a2d-a9de-cb78ca70586a req-b1c4649e-e9a8-4df4-91b3-9697ae4b496a service nova] Creating event network-changed:73003b71-b2fe-446a-9be7-3819b8e8dacb for instance cd0e4a30-0260-4885-9bc2-75584d349814 on hv-cinder-86160 Oct 17 18:00:15.676444 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-c5528d6f-1bf1-4a2d-a9de-cb78ca70586a req-b1c4649e-e9a8-4df4-91b3-9697ae4b496a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034855 Oct 17 18:00:15.677063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 264/546] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:15.746916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:15.747530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:15.753498 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:15.753976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:15.754409 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:15.755102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:15.755559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:15.755977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:15.888730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:15.896989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-64c5df96-cfa4-469e-927c-9b9d7bbad891 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154448 Oct 17 18:00:15.897605 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 283/547] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:15 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:16.013723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:16.014435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:16.020929 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:16.021475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:16.021913 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:16.022607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:16.023063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:16.023486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:16.037628 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 HTTP/1.1 Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:00:16.039247 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:00:16.040907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'bf4103da-d0cb-4d9c-b475-e0ee08b57398'} Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:00:16.042675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:00:16.044181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:00:16.045555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:00:16.045555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5baf086b-4c99-4f1f-9e23-b9f10723a553 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 404 len: 111 microversion: 2.1 time: 0.031946 Oct 17 18:00:16.045555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 265/548] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:16 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:00:16.050165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-497b11f4-1db0-41e0-b2fc-3f2278325f25 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '.version_select at 0x7f01962cc670>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:16.054900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-497b11f4-1db0-41e0-b2fc-3f2278325f25 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [ea2dcf75-167a-449d-b4e0-1de86d43871e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 18:00:16.292396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:16.293162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:16.299221 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:16.299807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:16.300309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:16.301110 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:16.301627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:16.302118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:16.438413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:16.446210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e1e17692-c440-4071-9d97-79b7dd5385c3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.157920 Oct 17 18:00:16.446772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 266/549] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:16 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:16.921092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:16.921700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:16.927618 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:16.928099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:16.928537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:16.929251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:16.929964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:16.930389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:17.061052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:17.062724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO oslo.messaging._drivers.impl_rabbit [None req-497b11f4-1db0-41e0-b2fc-3f2278325f25 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [ea2dcf75-167a-449d-b4e0-1de86d43871e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 37766. Oct 17 18:00:17.069263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e8716df5-2a35-4c0a-b1e2-125e05f4eb63 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.152597 Oct 17 18:00:17.069863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 267/550] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:16 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:17.131170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-497b11f4-1db0-41e0-b2fc-3f2278325f25 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398426015" status: 202 len: 0 microversion: 2.1 time: 1.084864 Oct 17 18:00:17.131747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 284/551] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398426015 => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:00:17.470766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:17.471600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:17.477576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:17.478057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:17.478499 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:17.479740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:17.480356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:17.480818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:17.502909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:17.618338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:17.626124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f9ae0c39-cf40-4b5e-9d2c-0c01d389179a tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.159217 Oct 17 18:00:17.626695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 268/552] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:17 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:17.925973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-86edf558-8614-4c2a-b7cb-4922d85b4bff tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: .version_select at 0x7f0196280af0>, body: {"keypair": {"name": "tempest-keypair-497316928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuLwi4VIbGdHtKqVo+XB+4a31q2Pd6VZGRj1AEo8FSNHHVHFGMGJo4lID5m5UQ8hnR/Ms4jipe9QEJpIEriH+XX9OTJr/2QWFzsX4u+bXUpv99IY/+hY4M8l4PShizYUQ=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:17.942438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-86edf558-8614-4c2a-b7cb-4922d85b4bff tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:00:17.946194 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-86edf558-8614-4c2a-b7cb-4922d85b4bff tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:00:18.016770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-86edf558-8614-4c2a-b7cb-4922d85b4bff tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094585 Oct 17 18:00:18.017302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 285/553] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 18:00:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:18.092974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:18.093575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:18.099954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:18.100425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:18.100877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:18.101555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:18.102006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:18.102422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:18.275986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:18.284585 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c8b548ff-aa7d-43cd-8bcf-23adb2109fe3 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.196175 Oct 17 18:00:18.285402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 269/554] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:18 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:18.648661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:18.649270 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:18.655225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:18.655697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:18.656122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:18.656892 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:18.657355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:18.657753 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:18.797588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:18.805810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-43fbfbae-f9ca-4cef-bd53-23b3810d33f5 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.161108 Oct 17 18:00:18.806400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 286/555] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:18 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:19.307555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:19.308245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:19.315280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:19.315754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:19.316183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:19.316891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:19.317347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:19.317796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:19.452308 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:19.461545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-71a1e6da-c326-4510-b282-f5fb2028c5af tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.158137 Oct 17 18:00:19.462123 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 270/556] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:19 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:19.829789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:19.830687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:19.832635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:19.837485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:19.837969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:19.838400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:19.846085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:19.846085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:19.846085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:19.974969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:19.983657 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5ddd2102-5e52-4fdc-a55d-1e90a67d7861 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.157728 Oct 17 18:00:19.984224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 287/557] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:19 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:20.239433 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1245956987", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a6940ab-f26f-4946-9f58-3b74b9998843"}], "security_groups": [{"name": "tempest-securitygroup--1818741043"}], "key_name": "tempest-keypair-497316928", "user_data": "}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:20.248192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:20.344453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] validate_networks() for [('7a6940ab-f26f-4946-9f58-3b74b9998843', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:00:20.486254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:20.486879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:20.493261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:20.493745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:20.494269 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:20.495111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:20.495565 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:20.496261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:20.708426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:20.717655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-03d9f797-c494-464d-ab8a-92849a781728 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.235687 Oct 17 18:00:20.718230 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 288/558] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:20 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:20.783747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:00:20.784169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:00:20.784661 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:00:20.785071 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:00:20.785480 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:00:20.794101 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:20.794579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:20.795012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:20.795742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:20.796192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:20.796635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:20.813123 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:00:20.817118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:00:20.828557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:00:20.830896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:00:20.961478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-dd8c5081-40f5-430e-aee1-b04439c1fd1a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.726181 Oct 17 18:00:20.962228 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 271/559] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:00:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:00:20.974600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0ed818db-0a73-4a74-b0db-f76ef25e8df7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:20.975316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0ed818db-0a73-4a74-b0db-f76ef25e8df7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:21.007232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:21.008000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:21.016254 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:21.016770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:21.017201 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:21.017927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:21.018374 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:21.018806 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:21.029880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0ed818db-0a73-4a74-b0db-f76ef25e8df7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:21.037842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0ed818db-0a73-4a74-b0db-f76ef25e8df7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1241 microversion: 2.1 time: 0.066735 Oct 17 18:00:21.038777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 289/560] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:20 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:21.153644 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:21.161375 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bbdfa635-83a4-40ed-87b2-dcb1b89e8745 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.157984 Oct 17 18:00:21.162136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 272/561] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:21 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:21.741677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:21.742309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:21.749461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:21.749938 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:21.750368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:21.751076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:21.751519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:21.751936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:21.881365 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:21.890163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2613182e-79ad-4db2-9244-6eb5ffb34f29 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.152425 Oct 17 18:00:21.890740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 290/562] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:21 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:22.061661 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:22.062205 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:22.068623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.069122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.069557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:22.070278 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.070729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.071151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:22.134768 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:22.142850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d5195574-6ab5-4e1b-adfa-66c4ab6126b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1245 microversion: 2.1 time: 0.085297 Oct 17 18:00:22.143414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 273/563] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:22 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:22.185550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:22.186247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:22.192132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.192786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.193259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:22.194062 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.194517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.195019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:22.327105 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:22.334568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fd2f5284-0418-4661-9621-aa99a1f7efd0 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.153048 Oct 17 18:00:22.336510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 291/564] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:22 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:22.467416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-febd6803-2c79-4b6d-b74a-474cda5a69b0 req-b78cf935-14e2-40b3-a1aa-9bcca9319567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0e4a30-0260-4885-9bc2-75584d349814", "name": "network-vif-plugged", "status": "completed", "tag": "73003b71-b2fe-446a-9be7-3819b8e8dacb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:22.477791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-febd6803-2c79-4b6d-b74a-474cda5a69b0 req-b78cf935-14e2-40b3-a1aa-9bcca9319567 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.478365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-febd6803-2c79-4b6d-b74a-474cda5a69b0 req-b78cf935-14e2-40b3-a1aa-9bcca9319567 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.478807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-febd6803-2c79-4b6d-b74a-474cda5a69b0 req-b78cf935-14e2-40b3-a1aa-9bcca9319567 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:22.490841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-febd6803-2c79-4b6d-b74a-474cda5a69b0 req-b78cf935-14e2-40b3-a1aa-9bcca9319567 service nova] Creating event network-vif-plugged:73003b71-b2fe-446a-9be7-3819b8e8dacb for instance cd0e4a30-0260-4885-9bc2-75584d349814 on hv-cinder-86160 Oct 17 18:00:22.497411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-febd6803-2c79-4b6d-b74a-474cda5a69b0 req-b78cf935-14e2-40b3-a1aa-9bcca9319567 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Oct 17 18:00:22.498007 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 274/565] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:22.912990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:22.913597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:22.920141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.920637 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.921076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:22.921761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:22.922219 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:22.922641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:23.058739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:23.067622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5f4e6ce7-b56f-48d2-a29d-0f3d265621ff tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.158468 Oct 17 18:00:23.068205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 292/566] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:22 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:23.166408 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:23.167136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:23.174293 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:23.174776 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:23.175211 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:23.175899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:23.176356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:23.176819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:23.245232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:23.253020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6f55584a-e019-417e-b369-af3accff55b5 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1293 microversion: 2.1 time: 0.090904 Oct 17 18:00:23.253617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 275/567] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:23 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:23.357400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:23.358011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:23.363942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:23.364435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:23.364908 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:23.365597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:23.366045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:23.366463 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:23.497868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:23.505521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-dcd2ebf4-bcb7-4aae-8e1e-00243558392b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1319 microversion: 2.1 time: 0.152115 Oct 17 18:00:23.506084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 293/568] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:23 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:24.091777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:24.092386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:24.098312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:24.098855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:24.099284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:24.100032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:24.100497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:24.100999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:24.234919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:24.245549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2cdbc963-2adb-4561-910c-65687acc25da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.158335 Oct 17 18:00:24.246350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 276/569] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:24 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:24.279272 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:24.279894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:24.285938 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:24.286451 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:24.287048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:24.287735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:24.288177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:24.288623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:24.359946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:24.368390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-258d8b51-8cbf-4e79-bcd4-818f528fb2ae tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1299 microversion: 2.1 time: 0.095320 Oct 17 18:00:24.369014 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 294/570] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:24 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:24.530091 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:24.530647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:24.537756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:24.538996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:24.538996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:24.539415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:24.539886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:24.540312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:24.976909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:24.987848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b9379da9-a7a1-4745-955b-0bf325420e51 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1508 microversion: 2.1 time: 0.462268 Oct 17 18:00:24.988803 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 277/571] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:24 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:25.010819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7f38b12-211c-4a64-8aa6-046438984b4a", "device": "/dev/sdb"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:25.014346 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:25.020854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.021405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.021899 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.022678 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.023192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.023615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.269830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:25.270429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:25.278646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.279132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.279563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.280508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.280986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.281403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.419182 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:25.427819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bbe647e9-4caa-4149-9a24-379ebe64f745 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.162132 Oct 17 18:00:25.428406 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 278/572] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:25 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:00:25.440132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:25.441468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:25.447562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.448217 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.448771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.452402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.452402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.452402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.586113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:25.593918 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fa660224-2d78-42ba-ad31-f12964c25a4a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.164519 Oct 17 18:00:25.594490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 279/573] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:25 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:25.629715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-b75ccb0d-41d9-44ee-9ef6-7e4187cdd48d req-00f0650d-f354-4bbe-96bd-2e074bf29967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9579f87-21e4-4c60-9ac5-3202aff271d7", "tag": "5954f595-71d8-46d9-9be9-68b7ea32dffb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:25.647664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b75ccb0d-41d9-44ee-9ef6-7e4187cdd48d req-00f0650d-f354-4bbe-96bd-2e074bf29967 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:25.648135 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b75ccb0d-41d9-44ee-9ef6-7e4187cdd48d req-00f0650d-f354-4bbe-96bd-2e074bf29967 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:25.648556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b75ccb0d-41d9-44ee-9ef6-7e4187cdd48d req-00f0650d-f354-4bbe-96bd-2e074bf29967 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:25.660369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-b75ccb0d-41d9-44ee-9ef6-7e4187cdd48d req-00f0650d-f354-4bbe-96bd-2e074bf29967 service nova] Creating event network-changed:5954f595-71d8-46d9-9be9-68b7ea32dffb for instance b9579f87-21e4-4c60-9ac5-3202aff271d7 on hv-cinder-86160 Oct 17 18:00:25.665739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-b75ccb0d-41d9-44ee-9ef6-7e4187cdd48d req-00f0650d-f354-4bbe-96bd-2e074bf29967 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039544 Oct 17 18:00:25.666659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 280/574] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:00:25.812168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8df069f9-625b-495a-882e-ae78dff1b786 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "POST /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.804825 Oct 17 18:00:25.818223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 295/575] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:00:25 2022] POST /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:26.453067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:26.453941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:26.460584 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:26.461092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:26.461522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:26.462207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:26.462655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:26.463075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:26.594053 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:26.602246 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-42042883-1707-4961-b584-1eb5c03267dc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154641 Oct 17 18:00:26.602904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 281/576] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:26 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:26.617561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:26.618284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:26.625881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:26.626360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:26.626885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:26.627572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:26.628021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:26.628441 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:26.760955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:26.769942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-998ae87d-528b-4704-b53d-2ccb925c5830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.156635 Oct 17 18:00:26.770508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 296/577] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:26 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:27.627775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:27.628389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:27.635224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:27.635745 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:27.636180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:27.637453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:27.637907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:27.638336 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:27.766199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:27.774712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4de9da23-aceb-4018-8b08-8a5cb98fd2cb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.150938 Oct 17 18:00:27.775330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 282/578] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:27 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:27.792781 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:27.793474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:27.799900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:27.800379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:27.800848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:27.801536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:27.802022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:27.802448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:27.936618 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:27.944174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9b0f1b11-8ac4-4dd8-8563-fbee1a513ea7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.155268 Oct 17 18:00:27.944766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 297/579] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:27 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:28.798798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:28.799405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:28.806043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:28.806519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:28.806955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:28.807638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:28.808092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:28.809039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:28.940901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:28.949151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f18883a8-e807-4fd4-b5e3-8da66c2e44f0 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154085 Oct 17 18:00:28.949798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 283/580] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:28 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:28.967334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:28.967930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:28.974220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:28.974688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:28.975114 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:28.975784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:28.976225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:28.976665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:28.995167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:29.113867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:29.121675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-89df7753-9e2d-47f5-aef5-82d5ba569d75 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.158094 Oct 17 18:00:29.122235 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 298/581] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:28 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:29.972034 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:29.972653 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:29.978946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:29.979414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:29.979847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:29.980872 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:29.981378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:29.981801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:30.114076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:30.122415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f2f058a2-0f46-4aaf-b00e-ba1404e9a5de tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154274 Oct 17 18:00:30.122976 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 284/582] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:29 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:30.144748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:30.145295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:30.152951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:30.153448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:30.153889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:30.154571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:30.155020 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:30.155443 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:30.284610 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:30.292186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5438881d-4839-4ef3-ba59-a962a0e9a341 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.151277 Oct 17 18:00:30.293546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 299/583] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:30 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:31.145281 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:31.145805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:31.147717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:31.148374 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:31.154196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:31.154680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:31.155115 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:31.155806 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:31.156256 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:31.156708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:31.286909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:31.295089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d0d124a9-0523-4075-8b08-404304bf21b9 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.153726 Oct 17 18:00:31.295648 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 285/584] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:31 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:31.316747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:31.317348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:31.319186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=12 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:31.324998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:31.325485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:31.325916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:31.326643 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:31.327091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:31.327507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:31.455618 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:31.463172 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1464cade-8516-4c99-8513-75e8ada3874c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.150418 Oct 17 18:00:31.463737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 300/585] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:31 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:32.317907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:32.318622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:32.325178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:32.325670 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:32.326106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:32.326805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:32.327257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:32.327682 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:32.457280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:32.466098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-402dd422-efd2-403c-81cb-a4645b2322da tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.151997 Oct 17 18:00:32.466701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 286/586] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:32 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:32.487737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:32.488461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:32.494938 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:32.495432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:32.495921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:32.496971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:32.497597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:32.498078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:32.508445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-f73777cd-3879-4eb4-9dfe-48167f98b69b req-c4266576-cdd5-4863-ad87-9c74eb6e8674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9579f87-21e4-4c60-9ac5-3202aff271d7", "name": "network-vif-plugged", "status": "completed", "tag": "5954f595-71d8-46d9-9be9-68b7ea32dffb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:32.513996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:32.519074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f73777cd-3879-4eb4-9dfe-48167f98b69b req-c4266576-cdd5-4863-ad87-9c74eb6e8674 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:32.519549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f73777cd-3879-4eb4-9dfe-48167f98b69b req-c4266576-cdd5-4863-ad87-9c74eb6e8674 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:32.519977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f73777cd-3879-4eb4-9dfe-48167f98b69b req-c4266576-cdd5-4863-ad87-9c74eb6e8674 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:32.523769 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:32.531670 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-f73777cd-3879-4eb4-9dfe-48167f98b69b req-c4266576-cdd5-4863-ad87-9c74eb6e8674 service nova] Creating event network-vif-plugged:5954f595-71d8-46d9-9be9-68b7ea32dffb for instance b9579f87-21e4-4c60-9ac5-3202aff271d7 on hv-cinder-86160 Oct 17 18:00:32.536490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-f73777cd-3879-4eb4-9dfe-48167f98b69b req-c4266576-cdd5-4863-ad87-9c74eb6e8674 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031813 Oct 17 18:00:32.537128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 287/587] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:00:32.640181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:32.648339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f5a9a4b4-99a7-4d4e-96c8-aa0d1d249fcb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.164474 Oct 17 18:00:32.648946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 301/588] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:32 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:33.490983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:33.491678 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:33.499659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:33.500072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:33.500534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:33.501246 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:33.501699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:33.502124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:33.633853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:33.642044 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-71635527-e838-4587-95b5-5aa6b539eb71 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.155821 Oct 17 18:00:33.642617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 288/589] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:33 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:33.673175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:33.673777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:33.680432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:33.680990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:33.681414 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:33.682085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:33.682526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:33.683052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:33.817854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:33.825589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9860c1cf-5053-404a-8e8e-e15d53050e88 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.156295 Oct 17 18:00:33.826143 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 302/590] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:33 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:34.665310 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:34.665916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:34.672409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:34.673448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:34.674563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:34.675277 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:34.675736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:34.676161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:34.823909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:34.833167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bd1af455-b06b-470e-a01c-46d6a7eeee7f tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.171728 Oct 17 18:00:34.833731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 289/591] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:34 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:34.849375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:34.849966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:34.853227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:34.856633 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:34.857117 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:34.857549 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:34.858238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:34.858689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:34.859107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:34.994402 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:35.002466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a8f7de1b-3e2b-4099-aa0c-5f69cfc860cf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1367 microversion: 2.1 time: 0.157247 Oct 17 18:00:35.003899 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 303/592] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:34 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:35.857059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:35.857772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:35.864405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:35.864923 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:35.865353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:35.866091 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:35.866564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:35.866979 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:36.001483 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:36.009791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f654a16d-570d-4510-8dfe-6e3a2eda3cc8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.156644 Oct 17 18:00:36.010369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 290/593] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:35 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:36.026085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:36.026685 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:36.033183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:36.033656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:36.034079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:36.034754 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:36.035201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:36.035616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:36.161875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:36.169632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-14e81f8e-e96e-4904-97c6-a266f01d275b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1557 microversion: 2.1 time: 0.147633 Oct 17 18:00:36.170194 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 304/594] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:36 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:36.192204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:36.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:36.198538 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:36.198954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:36.199381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:36.201126 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:36.201576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:36.201998 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:36.282222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-970564f8-831e-48d6-9440-f4bac6206855 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093734 Oct 17 18:00:36.282820 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 291/595] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 18:00:36 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:37.033797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:37.034400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:37.040902 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:37.041834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:37.041834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:37.042478 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:37.042933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:37.044052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:37.176477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:37.185135 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fca1471a-b69a-40eb-9a71-fa8c003a7934 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.155182 Oct 17 18:00:37.185839 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 305/596] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:37 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:37.505073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-c067dcdf-e271-468a-b7ab-72ef2e01b7ce req-b6287401-9f1d-4a58-a73b-ff5299d57b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9579f87-21e4-4c60-9ac5-3202aff271d7", "tag": "5954f595-71d8-46d9-9be9-68b7ea32dffb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:37.514264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c067dcdf-e271-468a-b7ab-72ef2e01b7ce req-b6287401-9f1d-4a58-a73b-ff5299d57b48 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:37.514732 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c067dcdf-e271-468a-b7ab-72ef2e01b7ce req-b6287401-9f1d-4a58-a73b-ff5299d57b48 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:37.515157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c067dcdf-e271-468a-b7ab-72ef2e01b7ce req-b6287401-9f1d-4a58-a73b-ff5299d57b48 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:37.526056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-c067dcdf-e271-468a-b7ab-72ef2e01b7ce req-b6287401-9f1d-4a58-a73b-ff5299d57b48 service nova] Creating event network-changed:5954f595-71d8-46d9-9be9-68b7ea32dffb for instance b9579f87-21e4-4c60-9ac5-3202aff271d7 on hv-cinder-86160 Oct 17 18:00:37.533441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-c067dcdf-e271-468a-b7ab-72ef2e01b7ce req-b6287401-9f1d-4a58-a73b-ff5299d57b48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032580 Oct 17 18:00:37.534039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 292/597] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:38.209704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:38.210293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:38.217515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:38.217997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:38.218429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:38.219123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:38.219846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:38.220266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:38.355874 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:38.365169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-05b0f251-81e7-44f8-a897-aaf5371076f4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.159286 Oct 17 18:00:38.365760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 306/598] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:38 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:39.390706 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:39.391508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:39.398060 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:39.398577 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:39.399011 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:39.399699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:39.400148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:39.400574 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:39.534014 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:39.542296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5ebad28a-84bf-4b2e-b13a-1e93126e3724 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.156819 Oct 17 18:00:39.542860 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 293/599] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:39 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:40.564753 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:40.565363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:40.571766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:40.572425 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:40.573019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:40.573456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:40.573932 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:40.574357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:40.707846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:40.716990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0b30006e-e08a-4156-bc91-bbb394ceba2b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.156147 Oct 17 18:00:40.717567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 307/600] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:40 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:41.740642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:41.741250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:41.747958 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:41.748430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:41.748878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:41.749555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:41.750027 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:41.750445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:41.882340 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:41.891077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a3cc10ba-1323-41bf-8123-db169eab79fc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154316 Oct 17 18:00:41.893094 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 294/601] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:41 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:42.914948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:42.915548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:42.922770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:42.923243 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:42.923671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:42.924353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:42.924831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:42.925496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:43.054297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:43.062687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c6aa1edc-dc6c-475b-87c1-717d319b23b8 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.151742 Oct 17 18:00:43.063253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 308/602] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:42 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:44.085475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:44.086079 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:44.091962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:44.092442 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:44.092923 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:44.093597 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:44.094055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:44.094476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:44.226685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:44.235719 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c963156b-fe2f-4962-9ff7-a73671ac7a8e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154257 Oct 17 18:00:44.236291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 295/603] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:44 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:45.258859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:45.259468 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:45.266301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:45.266781 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:45.267211 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:45.267892 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:45.268342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:45.268794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:45.400210 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:45.409450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-36d1fd4f-b36c-41e3-bb8d-87fe7eb87dda tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1734 microversion: 2.1 time: 0.154251 Oct 17 18:00:45.410042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 309/604] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:45 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:46.434144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:46.434751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:46.442065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:46.442544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:46.442979 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:46.443668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:46.444122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:46.444546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:46.569891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:46.578150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2bbc0048-e9a3-49f3-941a-41f11889948b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1714 microversion: 2.1 time: 0.148064 Oct 17 18:00:46.579748 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 296/605] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:46 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:46.689861 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:46.690370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:46.696564 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:46.697076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:46.697503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:46.698181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:46.698628 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:46.699046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:46.779922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] HTTP exception thrown: Cannot 'detach_volume' instance 62268bc4-006f-4d44-a766-5930b2cca957 while it is in vm_state rescued Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Request method failure captured: Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments/a369f7f3-d599-4e30-98ea-ce459dd3319a HTTP/1.1 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZc_LxtLnNF4-kOQ9U7p3o6IbidtToA8RcEcFI97Euc4n3M7A-xl1inD5QCE4jmsvUxd0homtc0JQXQtgUegBvwsJDFRhnk-4tfJjfLULjHqfHcNQ_tgPj1PVVrqB3-2GHjJEAZksdYwhTNriz4gzz1Rm-OfpyeTm8rPT_1Sd5nSiS0 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:00:46.781577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54dacea98b1448ab828595f9e1c31a13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}] Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: af69042a7ac34adb92bae0288e51aa76 Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:00:46.783158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Cannot 'detach_volume' instance 62268bc4-006f-4d44-a766-5930b2cca957 while it is in vm_state rescued Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'server_id': '62268bc4-006f-4d44-a766-5930b2cca957', 'id': 'a369f7f3-d599-4e30-98ea-ce459dd3319a'} Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62268bc4-006f-4d44-a766-5930b2cca957 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:00:46.784035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62268bc4-006f-4d44-a766-5930b2cca957 while it is in vm_state rescued Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62268bc4-006f-4d44-a766-5930b2cca957 while it is in vm_state rescued Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:00:46.785429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Returning 409 to user: Cannot 'detach_volume' instance 62268bc4-006f-4d44-a766-5930b2cca957 while it is in vm_state rescued {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:00:46.786426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6487bd54-d4b3-406c-8cdd-cc35c072186d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments/a369f7f3-d599-4e30-98ea-ce459dd3319a" status: 409 len: 152 microversion: 2.1 time: 0.097976 Oct 17 18:00:46.786426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 310/606] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:00:46 2022] DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments/a369f7f3-d599-4e30-98ea-ce459dd3319a => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 18:00:46.792141 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:46.792687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:46.799868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:46.800366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:46.800832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:46.807957 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:46.807957 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:46.807957 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.060993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3a4736b6-daec-4136-9a73-a52b99ac4af2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "POST /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/action" status: 202 len: 0 microversion: 2.1 time: 0.272220 Oct 17 18:00:47.063895 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 297/607] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:00:46 2022] POST /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:00:47.070690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:47.071302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:47.077242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.077729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.078252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.079041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.079494 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.079921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.213040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:47.221661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d032e72b-7b4e-468e-a17e-2d29b3fa627c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1722 microversion: 2.1 time: 0.154853 Oct 17 18:00:47.222276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 311/608] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:47 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:47.495147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:47.495756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:47.502761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.503213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.503646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.504343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.504829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.505261 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.538259 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e957826e-17cc-4737-999d-3cc9042e8544 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments/0c0cbbaf-f06c-4ace-9b8e-81d4cb9d9bdd" status: 200 len: 194 microversion: 2.20 time: 0.047933 Oct 17 18:00:47.538864 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 298/609] 10.222.0.58 () {60 vars in 1454 bytes} [Mon Oct 17 18:00:47 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments/0c0cbbaf-f06c-4ace-9b8e-81d4cb9d9bdd => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:00:47.607079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:47.607563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:47.614112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.614591 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.615020 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.615700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.616144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.616560 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.700144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lazy-loading 'services' on Instance uuid d932b27f-b1fd-42b4-a8e3-3908063839da {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:47.891771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9273eb7e-6a7d-4f79-9691-d82001f5c8c2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments/0c0cbbaf-f06c-4ace-9b8e-81d4cb9d9bdd" status: 202 len: 0 microversion: 2.20 time: 0.287634 Oct 17 18:00:47.892358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 312/610] 10.222.0.58 () {60 vars in 1457 bytes} [Mon Oct 17 18:00:47 2022] DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments/0c0cbbaf-f06c-4ace-9b8e-81d4cb9d9bdd => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:00:47.901115 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:47.903287 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:47.909500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.910013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.910652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.911403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.911859 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.912283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.939375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:47.939957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:47.945477 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c56ae94b-7a01-483f-8728-fe27c761ac3e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048540 Oct 17 18:00:47.946046 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 299/611] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 17 18:00:47 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:00:47.946250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.946725 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.947178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:47.947870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:47.948319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:47.948808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:48.030885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lazy-loading 'services' on Instance uuid cd0e4a30-0260-4885-9bc2-75584d349814 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:48.158920 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:48.248723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:48.250647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:48.257271 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6c36d33d-0dd0-4402-9b83-2ee8ab8adbe1 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814/os-volume_attachments/a7f38b12-211c-4a64-8aa6-046438984b4a" status: 202 len: 0 microversion: 2.1 time: 0.322460 Oct 17 18:00:48.263170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 313/612] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:00:47 2022] DELETE /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814/os-volume_attachments/a7f38b12-211c-4a64-8aa6-046438984b4a => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 18:00:48.263423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:48.263423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:48.263423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:48.263423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:48.263746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:48.263746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:48.395795 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:48.404034 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-80d634ff-4637-4dee-96c5-23c37eb5fd2d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1722 microversion: 2.1 time: 0.162436 Oct 17 18:00:48.404539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 300/613] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:48 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:48.959755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:48.962007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:48.968624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:48.969112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:48.969542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:48.970885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:48.971371 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:48.971789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:49.000222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7bdf25b2-818e-4556-a72c-b7df12ebe916 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045983 Oct 17 18:00:49.000799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 314/614] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 17 18:00:48 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:00:49.428469 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:49.429119 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:49.435804 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:49.436273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:49.436731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:49.437411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:49.437854 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:49.438271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:49.572921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:49.581418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-30b01c23-3e3c-4cb2-a34b-7b38937d8134 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1722 microversion: 2.1 time: 0.156806 Oct 17 18:00:49.581983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 301/615] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:49 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:50.012088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:50.014203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:50.021639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:50.022120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:50.022547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:50.023217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:50.023658 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:50.024071 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:50.053817 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8b6a2b7c-bdba-4b03-b5ee-9e6538da9e2d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045681 Oct 17 18:00:50.054370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 315/616] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 17 18:00:50 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:00:50.604343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:50.604985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:50.611898 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:50.612377 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:50.612844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:50.613535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:50.613993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:50.614421 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:50.741300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:50.749427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f9b8be69-a2c2-449b-bc62-a0f560ce111e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1728 microversion: 2.1 time: 0.148953 Oct 17 18:00:50.750001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 302/617] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:50 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:50.772152 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:50.772699 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:50.778588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:50.779065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:50.779497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:50.780170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:50.780639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:50.781091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:50.862625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6b3d7cb2-fbf7-408d-b845-1245fddb2333 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094188 Oct 17 18:00:50.864744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 316/618] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 18:00:50 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:00:51.066956 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:51.069040 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:51.074833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:51.075358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:51.075792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:51.076474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:51.076946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:51.077364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:51.107334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2602240f-e7e5-4ce2-b79c-985e417052f2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044135 Oct 17 18:00:51.107813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 303/619] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 17 18:00:51 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:00:51.817237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-32ded03f-df6a-41d2-ad77-445259e0f7ac req-201904f1-1002-4bae-9233-f5e39f15ec42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62268bc4-006f-4d44-a766-5930b2cca957", "tag": "2daf7e50-35c4-4647-922d-cb793b70fe1d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:51.827465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-32ded03f-df6a-41d2-ad77-445259e0f7ac req-201904f1-1002-4bae-9233-f5e39f15ec42 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:51.828162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-32ded03f-df6a-41d2-ad77-445259e0f7ac req-201904f1-1002-4bae-9233-f5e39f15ec42 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:51.829114 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-32ded03f-df6a-41d2-ad77-445259e0f7ac req-201904f1-1002-4bae-9233-f5e39f15ec42 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:51.841140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-32ded03f-df6a-41d2-ad77-445259e0f7ac req-201904f1-1002-4bae-9233-f5e39f15ec42 service nova] Creating event network-changed:2daf7e50-35c4-4647-922d-cb793b70fe1d for instance 62268bc4-006f-4d44-a766-5930b2cca957 on hv-cinder-86160 Oct 17 18:00:51.847494 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-32ded03f-df6a-41d2-ad77-445259e0f7ac req-201904f1-1002-4bae-9233-f5e39f15ec42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034133 Oct 17 18:00:51.848528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 317/620] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:52.119702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:52.122430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:52.133509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.134183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.134762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.135641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.136205 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.136758 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.156983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:00:52.171081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8da6e89b-576e-4089-9a46-3fec16d25608 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055455 Oct 17 18:00:52.172286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 304/621] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 17 18:00:52 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:52.243617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:52.244106 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:52.250312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.250787 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.251961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.252681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.253130 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.253631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.279853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:00:52.571253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:52.571786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:52.578162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.578634 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.579138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.582877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.583029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8275e1f8-3900-4b6e-b601-f33bd4a978d6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 204 len: 0 microversion: 2.20 time: 0.343446 Oct 17 18:00:52.583696 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 318/622] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 17 18:00:52 2022] DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 18:00:52.592815 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:52.593515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:52.596556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.597155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.600465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.601165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.601591 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.602282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.602722 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.603366 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.626791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:00:52.743470 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:52.754812 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:52.756309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:52.757504 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-40973bd6-f447-4bcf-9f7a-3ea1a99ac61c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.169467 Oct 17 18:00:52.758064 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 319/623] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:52 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:52.943089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9ce10e5a-4162-4e91-8a72-7c2b6a24f2d2 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 204 len: 0 microversion: 2.1 time: 0.383215 Oct 17 18:00:52.943675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 305/624] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:00:52 2022] DELETE /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:00:52.952617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:52.953265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:52.960348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.960858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.961291 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:52.961976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:52.962425 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:52.962879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:53.091281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:53.100018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c7e39323-6028-44ec-be19-5bf43abd5c74 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1560 microversion: 2.1 time: 0.151187 Oct 17 18:00:53.100617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 320/625] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:52 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:53.783974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:53.784581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:53.790979 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:53.791463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:53.791906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:53.792609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:53.793075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:53.793500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:53.870705 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-d973f0b3-541c-40e6-bd37-66a5539281c4 req-c2fe6d89-472d-44bb-a4c7-c42c469a42b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62268bc4-006f-4d44-a766-5930b2cca957", "tag": "2daf7e50-35c4-4647-922d-cb793b70fe1d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:53.880085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d973f0b3-541c-40e6-bd37-66a5539281c4 req-c2fe6d89-472d-44bb-a4c7-c42c469a42b1 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:53.880554 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d973f0b3-541c-40e6-bd37-66a5539281c4 req-c2fe6d89-472d-44bb-a4c7-c42c469a42b1 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:53.881132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d973f0b3-541c-40e6-bd37-66a5539281c4 req-c2fe6d89-472d-44bb-a4c7-c42c469a42b1 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:53.892746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-d973f0b3-541c-40e6-bd37-66a5539281c4 req-c2fe6d89-472d-44bb-a4c7-c42c469a42b1 service nova] Creating event network-changed:2daf7e50-35c4-4647-922d-cb793b70fe1d for instance 62268bc4-006f-4d44-a766-5930b2cca957 on hv-cinder-86160 Oct 17 18:00:53.897842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-d973f0b3-541c-40e6-bd37-66a5539281c4 req-c2fe6d89-472d-44bb-a4c7-c42c469a42b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030825 Oct 17 18:00:53.898426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 321/626] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:00:53.949707 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:53.958152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:53.959601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:53.960788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-93f78416-99b0-4f10-9f03-f87c4c163cef tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.181239 Oct 17 18:00:53.961359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 306/627] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:53 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:54.123469 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:54.124074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:54.130872 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:54.131345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:54.131773 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:54.132450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:54.132918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:54.133339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:54.265791 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:54.275192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-87478c61-0d9a-433b-a9e4-08a7ce7cb750 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1560 microversion: 2.1 time: 0.156100 Oct 17 18:00:54.275768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 322/628] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:54 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:54.985912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:54.986514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:54.993245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:54.993722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:54.994157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:54.994876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:54.995332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:54.995757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:55.126818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:55.135421 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:55.136828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:55.137981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2d769293-2b3a-4551-9d8b-8502e0f7e54a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.156047 Oct 17 18:00:55.138536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 307/629] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:54 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:55.300057 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:55.300676 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:55.307310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:55.307778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:55.308205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:55.308907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:55.309355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:55.309770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:55.436211 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:55.444164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4cf8807d-1982-47a7-b763-f4af02d62bf3 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1514 microversion: 2.1 time: 0.148082 Oct 17 18:00:55.444778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 323/630] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:55 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:56.163631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:56.164267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:56.170621 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:56.171097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:56.171528 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:56.172210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:56.172691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:56.173117 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:56.337337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:56.345330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:56.346832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:56.347973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bec46e9e-d73d-4cfa-9119-d3d0e00ea118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.188269 Oct 17 18:00:56.348534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 308/631] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:56 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:56.467388 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:56.468584 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:56.475837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:56.476691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:56.477136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:56.477831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:56.478282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:56.478703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:56.765177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:56.773349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-62ac9401-2711-4f1e-a478-6f99e26b06cf tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1514 microversion: 2.1 time: 0.309884 Oct 17 18:00:56.773922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 324/632] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:56 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:57.373350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:57.373934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:57.382133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:57.382645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:57.383210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:57.383919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:57.384368 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:57.384826 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:57.625708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:57.634440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:57.635876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:57.637057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c373e730-9abe-480a-8e8e-158a7e060812 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1725 microversion: 2.20 time: 0.267745 Oct 17 18:00:57.637679 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 309/633] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:57 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:00:57.796407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:57.797068 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:57.805783 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:57.806266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:57.806733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:57.807454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:57.807926 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:57.808342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:57.868359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-7f633a40-bff1-4f16-b30c-b4c18746ece4 req-34537390-7bc9-4d30-bc8a-1b86c97dd1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0e4a30-0260-4885-9bc2-75584d349814", "name": "network-vif-deleted", "tag": "73003b71-b2fe-446a-9be7-3819b8e8dacb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:57.878562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7f633a40-bff1-4f16-b30c-b4c18746ece4 req-34537390-7bc9-4d30-bc8a-1b86c97dd1c2 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:57.878993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7f633a40-bff1-4f16-b30c-b4c18746ece4 req-34537390-7bc9-4d30-bc8a-1b86c97dd1c2 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:57.879423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7f633a40-bff1-4f16-b30c-b4c18746ece4 req-34537390-7bc9-4d30-bc8a-1b86c97dd1c2 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:57.891045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-7f633a40-bff1-4f16-b30c-b4c18746ece4 req-34537390-7bc9-4d30-bc8a-1b86c97dd1c2 service nova] Creating event network-vif-deleted:73003b71-b2fe-446a-9be7-3819b8e8dacb for instance cd0e4a30-0260-4885-9bc2-75584d349814 on hv-cinder-86160 Oct 17 18:00:57.897492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-7f633a40-bff1-4f16-b30c-b4c18746ece4 req-34537390-7bc9-4d30-bc8a-1b86c97dd1c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Oct 17 18:00:57.898118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 310/634] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:00:57.914645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:57.922503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d623ba30-8008-4687-82b2-0940e0a9221d tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1472 microversion: 2.1 time: 0.129986 Oct 17 18:00:57.923070 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 325/635] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:57 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1472 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:58.663392 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:58.664089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:58.670716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:58.671155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:58.671594 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:58.672282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:58.672765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:58.673188 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:58.704896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:58.705373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:58.706991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:58.707445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lazy-loading 'fault' on Instance uuid d932b27f-b1fd-42b4-a8e3-3908063839da {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:58.751544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:58.759904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:58.761456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:58.762695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-13a58189-140d-4a26-87d3-1cb0776090a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1371 microversion: 2.20 time: 0.104159 Oct 17 18:00:58.763325 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 311/636] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:58 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:58.947373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:58.948002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:58.954817 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:58.955330 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:58.956672 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:58.957475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:58.957936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:58.958356 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:58.991514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:58.992059 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:58.992496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:58.993160 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lazy-loading 'fault' on Instance uuid cd0e4a30-0260-4885-9bc2-75584d349814 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:59.039283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67de166f6bb4a66ae1b70335035a02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83fc47293e042d99a58560f5c847558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:59.047227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4fdcc8a6-9a5c-4d20-b840-102a5038f46b tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 200 len: 1309 microversion: 2.1 time: 0.103717 Oct 17 18:00:59.047801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 326/637] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:00:58 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:00:59.789064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:00:59.789604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:00:59.796053 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:59.796527 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:59.797043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:59.797724 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:59.798174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:59.798597 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:59.830886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:59.831452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:59.831887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:59.832338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lazy-loading 'fault' on Instance uuid d932b27f-b1fd-42b4-a8e3-3908063839da {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:00:59.875813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:59.883924 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:59.885510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:00:59.886702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-813102f7-78c3-4c6d-aa2d-9fcaaa17defc tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 200 len: 1371 microversion: 2.20 time: 0.101707 Oct 17 18:00:59.887264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 312/638] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:00:59 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:00:59.919187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-22cc0e37-9c91-40e6-8287-a907b012f2f6 req-8644a67b-18bf-4e64-85da-54a1771b7252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d932b27f-b1fd-42b4-a8e3-3908063839da", "name": "network-vif-deleted", "tag": "159ad1ae-f38b-4dca-afd5-a41b7031cb8c"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:00:59.929245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-22cc0e37-9c91-40e6-8287-a907b012f2f6 req-8644a67b-18bf-4e64-85da-54a1771b7252 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:00:59.930301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-22cc0e37-9c91-40e6-8287-a907b012f2f6 req-8644a67b-18bf-4e64-85da-54a1771b7252 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:00:59.930511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-22cc0e37-9c91-40e6-8287-a907b012f2f6 req-8644a67b-18bf-4e64-85da-54a1771b7252 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:00:59.940945 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-22cc0e37-9c91-40e6-8287-a907b012f2f6 req-8644a67b-18bf-4e64-85da-54a1771b7252 service nova] Creating event network-vif-deleted:159ad1ae-f38b-4dca-afd5-a41b7031cb8c for instance d932b27f-b1fd-42b4-a8e3-3908063839da on hv-cinder-86160 Oct 17 18:00:59.946046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-22cc0e37-9c91-40e6-8287-a907b012f2f6 req-8644a67b-18bf-4e64-85da-54a1771b7252 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Oct 17 18:00:59.946675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 327/639] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:00.069945 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:00.070472 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] [instance: cd0e4a30-0260-4885-9bc2-75584d349814] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:00.076331 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:00.076842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:00.077278 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:00.077962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:00.078414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:00.078838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:00.094032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] HTTP exception thrown: Instance cd0e4a30-0260-4885-9bc2-75584d349814 could not be found. Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Request method failure captured: Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 HTTP/1.1 Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZejsL0YUJOth34-v205_saW9P0oZ9B5F-k1LP56rURvzsdEdmItcxP1xJAqc2ErczrAHwgTBGGk0So4MeaWIBJVybwul_rwDHU24wZofladD8kJoq8GOGogrGnMlcyhcupBxQfCrQaKy7-AL_dSp9gQqjwpMgB_3xCUUlYdUK5DtCs Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: a83fc47293e042d99a58560f5c847558 Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1597802632 Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:01:00.095636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a83fc47293e042d99a58560f5c847558"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a83fc47293e042d99a58560f5c847558", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a83fc47293e042d99a58560f5c847558"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a83fc47293e042d99a58560f5c847558"}]}] Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesSnapshotTestJSON-1597802632 Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: a83fc47293e042d99a58560f5c847558 Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1597802632 Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesSnapshotTestJSON-1597802632-project Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: c67de166f6bb4a66ae1b70335035a02c Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesSnapshotTestJSON-1597802632-project Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance cd0e4a30-0260-4885-9bc2-75584d349814 could not be found. Oct 17 18:01:00.097955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'cd0e4a30-0260-4885-9bc2-75584d349814'} Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd0e4a30-0260-4885-9bc2-75584d349814 could not be found. Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:00.098866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd0e4a30-0260-4885-9bc2-75584d349814 could not be found. Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd0e4a30-0260-4885-9bc2-75584d349814 could not be found. Oct 17 18:01:00.100382 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.101701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] Returning 404 to user: Instance cd0e4a30-0260-4885-9bc2-75584d349814 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:00.101701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-50324a9c-b746-4e22-9a62-91ca74304f27 tempest-VolumesSnapshotTestJSON-1597802632 tempest-VolumesSnapshotTestJSON-1597802632-project] 10.222.0.58 "GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814" status: 404 len: 111 microversion: 2.1 time: 0.031702 Oct 17 18:01:00.101701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 313/640] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:00 2022] GET /compute/v2.1/servers/cd0e4a30-0260-4885-9bc2-75584d349814 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:01:00.912222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:00.913066 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:00.919312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:00.919786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:00.920215 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:00.920922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:00.921364 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:00.921780 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:00.937433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] HTTP exception thrown: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Request method failure captured: Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da HTTP/1.1 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdE3EryxmD6EwzKIju7H3HluYy3QOTDOSG3qHeZgzbFMgvwITcjSZIe_eFRE66KO_nnh-udoDnH6h6uqdF_XbHRx6y5MY1uR77N2KgyJvSLPASsQ0-GNLoBtbeO__3oNaAC6oPG9yta9OWS_TwsDi1cJhdYV7xq2PggzsSfK8FIGR0 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:01:00.939039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8272c0b90914361ae6f6c3a062380df", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}] Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 31a5d88c557c45b38724e8dafc0d0296 Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:01:00.943382 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'd932b27f-b1fd-42b4-a8e3-3908063839da'} Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:00.944164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:01:00.945755 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:00.946809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Returning 404 to user: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:00.946809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-89824f3b-bf06-41a8-8041-693fc32e7224 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 404 len: 111 microversion: 2.20 time: 0.033832 Oct 17 18:01:00.946809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 328/641] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:00 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:01:00.950190 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c3f3ce3f-fe61-4f59-b4e0-10182ee3b081 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '.version_select at 0x7f0196232280>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:01.012303 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c3f3ce3f-fe61-4f59-b4e0-10182ee3b081 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554265394" status: 204 len: 0 microversion: 2.20 time: 0.065796 Oct 17 18:01:01.012925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 314/642] 10.222.0.58 () {60 vars in 1259 bytes} [Mon Oct 17 18:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554265394 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 18:01:01.724470 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-17b6ad37-3e46-4b7c-8106-b874fa20af59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'create', calling method: .version_select at 0x7f019611ba60>, body: {"keypair": {"name": "tempest-keypair-964855695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzij0MnztG0zzNd2U24o/LjZaX3yQPPgwEa9GNc7AA0/O7XPznHZ8W5kOm5cdcG9gYBaj30pGRptIHzbxzQ7WKGAaoK84/pC2cBOIcMlk8LEEzU0eujRLZZnqKlg5Iq2Q=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:01.740467 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-17b6ad37-3e46-4b7c-8106-b874fa20af59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for project b8272c0b90914361ae6f6c3a062380df. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:01:01.744383 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-17b6ad37-3e46-4b7c-8106-b874fa20af59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for user 31a5d88c557c45b38724e8dafc0d0296 and project b8272c0b90914361ae6f6c3a062380df. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:01:01.818889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-17b6ad37-3e46-4b7c-8106-b874fa20af59 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.098651 Oct 17 18:01:01.819484 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 329/643] 10.222.0.58 () {62 vars in 1200 bytes} [Mon Oct 17 18:01:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 18:01:03.867420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1309716292", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "994c43a5-d813-4de6-ade7-7c63b869b2da"}], "security_groups": [{"name": "tempest-securitygroup--1246860168"}], "key_name": "tempest-keypair-964855695", "user_data": "}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:03.877305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:03.973102 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] validate_networks() for [('994c43a5-d813-4de6-ade7-7c63b869b2da', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:01:04.343121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:01:04.343537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:01:04.344004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:01:04.344403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:01:04.344945 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:01:04.354232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:04.354734 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:04.355160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:04.355875 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:04.356319 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:04.356774 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:04.373295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for project b8272c0b90914361ae6f6c3a062380df. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:01:04.377164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Getting quotas for user 31a5d88c557c45b38724e8dafc0d0296 and project b8272c0b90914361ae6f6c3a062380df. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:01:04.388857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:01:04.391108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:01:04.510344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cdb0569e-547d-4945-b2b3-6ab904008196 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.647411 Oct 17 18:01:04.511151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 315/644] 10.222.0.58 () {62 vars in 1188 bytes} [Mon Oct 17 18:01:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 18:01:04.523385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f1f39cbc-014b-4df6-9a4b-291ebbb36e29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:04.524014 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f1f39cbc-014b-4df6-9a4b-291ebbb36e29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:04.582752 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f1f39cbc-014b-4df6-9a4b-291ebbb36e29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:04.591130 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f1f39cbc-014b-4df6-9a4b-291ebbb36e29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:04.592546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f1f39cbc-014b-4df6-9a4b-291ebbb36e29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:04.593702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f1f39cbc-014b-4df6-9a4b-291ebbb36e29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1281 microversion: 2.20 time: 0.075422 Oct 17 18:01:04.594247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 330/645] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:04 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:01:05.618473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:05.619087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:05.626136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:05.627962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:05.627962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:05.627962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:05.628679 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:05.628795 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:05.804412 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:05.812843 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:05.814292 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:05.816024 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c78b2c44-4459-40e9-9154-4a13344d6948 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1285 microversion: 2.20 time: 0.201379 Oct 17 18:01:05.816925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 316/646] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:05 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:06.841912 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:06.842595 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:06.846331 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:06.851460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:06.851945 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:06.852488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:06.853229 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:06.853675 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:06.854288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:06.998457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:07.008254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:07.012097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:07.012097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-34193e9a-0404-44ac-a455-53a5bb89a50b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1341 microversion: 2.20 time: 0.173274 Oct 17 18:01:07.012097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 331/647] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:06 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:08.038931 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:08.039532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:08.046065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:08.051540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:08.051540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:08.051540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:08.051540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:08.051909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:08.255815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:08.264093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:08.265609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:08.266850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6cc54fee-5c34-40ad-8cd1-120d149a924d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.233093 Oct 17 18:01:08.267419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 317/648] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:08 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:08.737298 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-dbdd128d-248f-47c0-8c93-b2ffbb7c0191 req-158dc8b6-138d-40f1-a670-af4aac6c402c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:08.751547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-dbdd128d-248f-47c0-8c93-b2ffbb7c0191 req-158dc8b6-138d-40f1-a670-af4aac6c402c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:08.751547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-dbdd128d-248f-47c0-8c93-b2ffbb7c0191 req-158dc8b6-138d-40f1-a670-af4aac6c402c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:08.751547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-dbdd128d-248f-47c0-8c93-b2ffbb7c0191 req-158dc8b6-138d-40f1-a670-af4aac6c402c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:08.759867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-dbdd128d-248f-47c0-8c93-b2ffbb7c0191 req-158dc8b6-138d-40f1-a670-af4aac6c402c service nova] Creating event network-changed:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:01:08.764619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-dbdd128d-248f-47c0-8c93-b2ffbb7c0191 req-158dc8b6-138d-40f1-a670-af4aac6c402c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Oct 17 18:01:08.765207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 332/649] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:09.292672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:09.293286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:09.300386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:09.301518 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:09.302017 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:09.303066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:09.303513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:09.303952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:09.507157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:09.516389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:09.518116 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:09.519999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e6ef5c97-6354-427a-bdd4-d3eca9cda7bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.231662 Oct 17 18:01:09.520571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 318/650] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:09 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:10.547046 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:10.547722 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:10.554197 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:10.554671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:10.555353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:10.556040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:10.556489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:10.556936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:10.950184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:10.959154 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:10.960802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:10.964293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a195e3bb-6eec-48fe-9eda-3e8b6707ddd3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.421607 Oct 17 18:01:10.964293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 333/651] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:10 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:01:11.989356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:11.989966 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:11.996434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:11.996943 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:11.997381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:11.998069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:11.998519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:11.998942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:12.125109 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:12.135855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:12.137305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:12.138401 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-66654883-95df-4904-8eba-6a13e7244122 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.153204 Oct 17 18:01:12.138978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 319/652] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:11 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:13.163894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:13.164500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:13.171043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:13.171518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:13.171950 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:13.172664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:13.173122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:13.173544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:13.178113 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:13.308110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:13.316153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:13.318772 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:13.319859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-34fe0cbd-2029-45ea-ac9e-ac7eb5bdf5e8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.159980 Oct 17 18:01:13.320748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 334/653] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:13 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:14.345221 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:14.345868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:14.353305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:14.353788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:14.354218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:14.354912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:14.355472 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:14.355901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:14.372049 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:14.387641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:14.555451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:14.563719 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:14.565199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:14.566400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-66fe4d98-9952-419f-8d14-2bd3bf72595f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.225423 Oct 17 18:01:14.566951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 320/654] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:14 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:15.591645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:15.592810 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:15.598159 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:15.600809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:15.601286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:15.601748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:15.602480 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:15.602924 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:15.603339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:15.735733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:15.744304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:15.745758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:15.746834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-42c71fa7-72e9-4223-8409-81f5290551d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.159076 Oct 17 18:01:15.747398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 335/655] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:15 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:15.997340 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-526cc801-2ed3-4a4b-9351-fe3f823d10fe req-95cdb4aa-dc86-4988-9524-d535a49cc83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "name": "network-vif-plugged", "status": "completed", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:16.008833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-526cc801-2ed3-4a4b-9351-fe3f823d10fe req-95cdb4aa-dc86-4988-9524-d535a49cc83a service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:16.009314 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-526cc801-2ed3-4a4b-9351-fe3f823d10fe req-95cdb4aa-dc86-4988-9524-d535a49cc83a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:16.009773 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-526cc801-2ed3-4a4b-9351-fe3f823d10fe req-95cdb4aa-dc86-4988-9524-d535a49cc83a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:16.023513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-526cc801-2ed3-4a4b-9351-fe3f823d10fe req-95cdb4aa-dc86-4988-9524-d535a49cc83a service nova] Creating event network-vif-plugged:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:01:16.028465 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-526cc801-2ed3-4a4b-9351-fe3f823d10fe req-95cdb4aa-dc86-4988-9524-d535a49cc83a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034779 Oct 17 18:01:16.029087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 321/656] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:16.771794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:16.772393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:16.778821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:16.779865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:16.779865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:16.780410 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:16.780885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:16.781327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:16.916707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:16.924650 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:16.926465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:16.927625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1c204d8f-9a2a-4515-8416-0bce1d5fd361 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.160349 Oct 17 18:01:16.928177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 336/657] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:16 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:17.955098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:17.955793 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:17.962583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:17.963050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:17.963473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:17.964151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:17.964613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:17.965038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:17.984429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:18.095845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:18.105016 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:18.106563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:18.107662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-801e1846-c33a-42c9-843f-238c32372a05 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1407 microversion: 2.20 time: 0.157837 Oct 17 18:01:18.108221 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 322/658] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:17 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:19.133854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:19.134723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:19.141298 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:19.141776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:19.142205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:19.142889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:19.143339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:19.143760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:19.275397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:19.283485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:19.284969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:19.286115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c7dc76fc-d637-4be3-a931-52e2822e1461 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1600 microversion: 2.20 time: 0.157234 Oct 17 18:01:19.286681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 337/659] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:19 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:01:19.311723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:19.312251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:19.318617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:19.319075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:19.319510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:19.320197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:19.320708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:19.321144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:19.397106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-eb85bea4-de9c-406a-b69c-1bcd381953bb tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089167 Oct 17 18:01:19.397704 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 323/660] 10.222.0.58 () {60 vars in 1316 bytes} [Mon Oct 17 18:01:19 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:01:20.403885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-c1acc378-a805-4646-b47a-abc39bfdb372 req-31b1928d-37e3-4829-85e3-e4353775d8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:20.414157 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-c1acc378-a805-4646-b47a-abc39bfdb372 req-31b1928d-37e3-4829-85e3-e4353775d8dc service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:20.414629 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-c1acc378-a805-4646-b47a-abc39bfdb372 req-31b1928d-37e3-4829-85e3-e4353775d8dc service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:20.415054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-c1acc378-a805-4646-b47a-abc39bfdb372 req-31b1928d-37e3-4829-85e3-e4353775d8dc service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:20.426370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-c1acc378-a805-4646-b47a-abc39bfdb372 req-31b1928d-37e3-4829-85e3-e4353775d8dc service nova] Creating event network-changed:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:01:20.432443 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-c1acc378-a805-4646-b47a-abc39bfdb372 req-31b1928d-37e3-4829-85e3-e4353775d8dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032268 Oct 17 18:01:20.433433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 338/661] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:22.410866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:22.411445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:22.418563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:22.419043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:22.423285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:22.423285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:22.423285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:22.423285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:22.444431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c0998ab7-e632-412c-9dee-cc5b21151f22 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.092419 Oct 17 18:01:22.445018 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 324/662] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 18:01:22 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/ips => generated 149 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:23.985221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eecbb3f-5e31-4005-8243-63d34746bdd2"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:23.987800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:23.994584 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:23.995060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:23.995514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:23.996252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:23.996749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:23.997174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:24.746671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b85065ca-f379-4f5b-a495-8d8409c0c738 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766484 Oct 17 18:01:24.747196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 339/663] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:01:23 2022] POST /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:32.306100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eecbb3f-5e31-4005-8243-63d34746bdd2"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:32.308544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:32.315659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.316173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.316672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.317334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.317792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.318227 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.397929 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Invalid volume: volume 7eecbb3f-5e31-4005-8243-63d34746bdd2 is already attached to instances: b9579f87-21e4-4c60-9ac5-3202aff271d7 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: POST /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments HTTP/1.1 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 74 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:01:32.399625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {"volumeAttachment": {"volumeId": "7eecbb3f-5e31-4005-8243-63d34746bdd2"}} Oct 17 18:01:32.401339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Invalid volume: volume 7eecbb3f-5e31-4005-8243-63d34746bdd2 is already attached to instances: b9579f87-21e4-4c60-9ac5-3202aff271d7 Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'server_id': 'b9579f87-21e4-4c60-9ac5-3202aff271d7', 'body': {'volumeAttachment': {'volumeId': '7eecbb3f-5e31-4005-8243-63d34746bdd2'}}} Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7eecbb3f-5e31-4005-8243-63d34746bdd2 is already attached to instances: b9579f87-21e4-4c60-9ac5-3202aff271d7 Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:32.402206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7eecbb3f-5e31-4005-8243-63d34746bdd2 is already attached to instances: b9579f87-21e4-4c60-9ac5-3202aff271d7 Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:32.404360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7eecbb3f-5e31-4005-8243-63d34746bdd2 is already attached to instances: b9579f87-21e4-4c60-9ac5-3202aff271d7 Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 400 to user: Invalid volume: volume 7eecbb3f-5e31-4005-8243-63d34746bdd2 is already attached to instances: b9579f87-21e4-4c60-9ac5-3202aff271d7 {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5be68f3e-285c-4999-9c28-0a0ffb9c57f9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100206 Oct 17 18:01:32.405877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 325/664] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:01:32 2022] POST /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:01:32.470908 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:32.471479 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:32.477648 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.478126 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.478557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.479242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.479802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.480152 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.558992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'services' on Instance uuid b9579f87-21e4-4c60-9ac5-3202aff271d7 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:32.735859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7b3d9bb8-979f-46c2-ace5-cd01137baa40 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments/7eecbb3f-5e31-4005-8243-63d34746bdd2" status: 202 len: 0 microversion: 2.1 time: 0.269675 Oct 17 18:01:32.736555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 340/665] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:01:32 2022] DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments/7eecbb3f-5e31-4005-8243-63d34746bdd2 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:01:32.745415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:32.747885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:32.754175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.754701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.755137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.755837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.756289 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.756828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.788245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-968192ce-1981-4ab3-9e83-b11abc4ec5f1 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047167 Oct 17 18:01:32.788838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 326/666] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:01:32 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:32.898326 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:32.898326 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:32.900697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.902562 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.903039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.903792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:32.904262 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:32.904742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:32.986268 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'services' on Instance uuid 62268bc4-006f-4d44-a766-5930b2cca957 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:33.174860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-157302f6-d808-4787-ae7a-fa30ceb4cf3c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments/a369f7f3-d599-4e30-98ea-ce459dd3319a" status: 202 len: 0 microversion: 2.1 time: 0.285500 Oct 17 18:01:33.175473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 341/667] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:01:32 2022] DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments/a369f7f3-d599-4e30-98ea-ce459dd3319a => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 18:01:33.184171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:33.186380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:33.192419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:33.192932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:33.193361 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:33.194041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:33.194488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:33.194907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:33.224518 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-265f22dc-e58a-4bbb-9a88-06f218a5190c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Oct 17 18:01:33.225014 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 327/668] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:01:33 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:33.802214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:33.804405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:33.811605 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:33.812128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:33.818085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:33.818085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:33.818085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:33.818085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:33.843424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-448610eb-7a7e-4f78-a0e4-7acb2959d216 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Oct 17 18:01:33.843988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 342/669] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:01:33 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:34.237877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:34.240094 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:34.242437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:34.247427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:34.247957 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:34.248397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:34.249178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:34.249635 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:34.250059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:34.281158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-28d5d30f-50ee-4ec2-bbd9-0d1aa57bc82b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Oct 17 18:01:34.281722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 328/670] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:01:34 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:34.856045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:34.858229 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:34.864636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:34.865118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:34.865546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:34.866234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:34.866739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:34.867101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:34.899749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a0dd1fec-1ac9-4381-9cbd-d0e55bb57273 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047519 Oct 17 18:01:34.900309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 343/671] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:01:34 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:01:34.968794 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:34.969473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:34.975829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:34.976307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:34.976783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:34.977470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:34.977924 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:34.978350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.005080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:01:35.273096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-058ff050-6ecd-4975-9bd1-ef2d080cd31f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 204 len: 0 microversion: 2.1 time: 0.308138 Oct 17 18:01:35.273821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 329/672] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:01:34 2022] DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:01:35.281950 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:35.282590 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:35.288621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.289131 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.289556 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.290230 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.290673 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.291089 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.293281 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:35.296582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:35.302761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.308536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.308536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.308536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.308536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.308964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.338598 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-503cd62d-5a7b-4651-9c11-b38f157a5a89 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049690 Oct 17 18:01:35.339167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 330/673] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:01:35 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 18:01:35.414771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:35.415258 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:35.422347 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.422832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.423265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.423949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.424480 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.424941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.430111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:35.438839 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a57380be-cf0c-4c5f-85c5-caad9419f9bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1681 microversion: 2.1 time: 0.160751 Oct 17 18:01:35.439504 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 344/674] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:35 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:35.451411 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:01:35.718712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-60aa681a-b11b-45e8-bb14-c9cbb528345e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 204 len: 0 microversion: 2.1 time: 0.307500 Oct 17 18:01:35.719290 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 331/675] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:01:35 2022] DELETE /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 18:01:35.727178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:35.727775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:35.734958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.735433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.735868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.736541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:35.737025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:35.742512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:35.874086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:35.882316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cc37f02f-1f1c-4af8-9e83-c339a98002e4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1688 microversion: 2.1 time: 0.158874 Oct 17 18:01:35.882887 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 345/676] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:35 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:36.463313 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:36.464092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:36.470507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:36.470989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:36.471430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:36.472122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:36.472579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:36.473031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:36.599365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:36.607052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8d49d216-ddd1-40d2-8861-52d78c4f3e07 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1681 microversion: 2.1 time: 0.148032 Oct 17 18:01:36.607672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 332/677] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:36 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:36.905311 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:36.905911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:36.912326 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:36.912906 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:36.913333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:36.914009 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:36.914453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:36.914898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:37.047402 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:37.055022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1feadf54-5c51-417e-8889-807c3e425c73 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1688 microversion: 2.1 time: 0.153763 Oct 17 18:01:37.055847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 346/678] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:36 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:37.631030 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:37.631631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:37.638157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:37.638632 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:37.639061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:37.639741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:37.640186 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:37.640617 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:37.767407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:37.774959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a1cedfe7-4589-4f05-be30-cc0fc5484d27 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1681 microversion: 2.1 time: 0.147766 Oct 17 18:01:37.775517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 333/679] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:37 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:38.079137 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:38.079656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:38.086045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:38.086525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:38.086958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:38.087644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:38.088097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:38.088522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:38.216346 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:38.224185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-688055ff-e224-4c46-82e1-288cdc27f70e tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1688 microversion: 2.1 time: 0.148998 Oct 17 18:01:38.224852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 347/680] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:38 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:38.798582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:38.799226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:38.806164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:38.806642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:38.807079 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:38.807765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:38.808219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:38.808670 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:38.943606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:38.951940 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b11fb512-7990-414a-a0fb-b739a3d4d816 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1681 microversion: 2.1 time: 0.157250 Oct 17 18:01:38.952513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 334/681] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:38 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:01:39.247434 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:39.248034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:39.254540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:39.255025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:39.255452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:39.256135 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:39.256583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:39.257023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:39.385641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:39.389941 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:39.394381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-66db8ffd-48f4-46e6-819d-d1d24d6c8970 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1688 microversion: 2.1 time: 0.150843 Oct 17 18:01:39.394936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 348/682] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:39 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:39.976439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:39.977075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:39.984451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:39.984949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:39.985379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:39.986057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:39.986600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:39.987025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:40.125673 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:40.133332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cf8d4ff5-a89d-4ccd-b7f8-1e672461fc74 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1681 microversion: 2.1 time: 0.160991 Oct 17 18:01:40.133839 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 335/683] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:39 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:40.417099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:40.418315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:40.425898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:40.426397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:40.426811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:40.427502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:40.427949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:40.428370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:41.014053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:41.021919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-af031d3d-e12b-401b-8c33-fcb9eff1b776 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1688 microversion: 2.1 time: 0.608586 Oct 17 18:01:41.022497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 349/684] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:40 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1688 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:41.157853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:41.158467 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:41.164964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:41.165442 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:41.165875 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:41.166559 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:41.167012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:41.167461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:41.186241 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:41.443183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:41.449398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ac2cf730-6b96-4ae3-9534-e56d2cbe48a3 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1681 microversion: 2.1 time: 0.296104 Oct 17 18:01:41.450356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 336/685] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:41 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1681 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:42.045471 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:42.046016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:42.048308 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=38 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:42.053141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:42.053639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:42.054061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:42.054765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:42.055221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:42.055895 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:42.183735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:42.193178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-81713bb5-bb8f-4a49-b95e-a0cfb441ff41 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1620 microversion: 2.1 time: 0.151776 Oct 17 18:01:42.207473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 350/686] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:42 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1620 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:42.485389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-b20400e6-61be-4e15-a8a4-b923a327340f req-bff5ecd9-c202-4805-a6f1-6fb29809fcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62268bc4-006f-4d44-a766-5930b2cca957", "name": "network-vif-deleted", "tag": "2daf7e50-35c4-4647-922d-cb793b70fe1d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:42.488201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:42.488916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:42.499720 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:42.502751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:42.502751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:42.502751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:42.502751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:42.503075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:42.525566 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b20400e6-61be-4e15-a8a4-b923a327340f req-bff5ecd9-c202-4805-a6f1-6fb29809fcfb service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:42.526041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b20400e6-61be-4e15-a8a4-b923a327340f req-bff5ecd9-c202-4805-a6f1-6fb29809fcfb service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:42.526468 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-b20400e6-61be-4e15-a8a4-b923a327340f req-bff5ecd9-c202-4805-a6f1-6fb29809fcfb service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:42.570766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-b20400e6-61be-4e15-a8a4-b923a327340f req-bff5ecd9-c202-4805-a6f1-6fb29809fcfb service nova] Creating event network-vif-deleted:2daf7e50-35c4-4647-922d-cb793b70fe1d for instance 62268bc4-006f-4d44-a766-5930b2cca957 on hv-cinder-86160 Oct 17 18:01:42.581334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:42.586489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-b20400e6-61be-4e15-a8a4-b923a327340f req-bff5ecd9-c202-4805-a6f1-6fb29809fcfb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279268 Oct 17 18:01:42.592717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ff2f0e85-31f1-4b15-89ef-a8b1ce1c18cb tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1326 microversion: 2.1 time: 0.122466 Oct 17 18:01:42.592873 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 337/687] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:42.595304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 351/688] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:42 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:43.222431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:43.223459 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:43.230503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:43.231259 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:43.232306 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:43.233081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:43.233540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:43.234147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:43.270548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:43.271465 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:43.271919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:43.272377 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'fault' on Instance uuid 62268bc4-006f-4d44-a766-5930b2cca957 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:43.318962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:43.328748 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6db7f319-a276-4d1c-93aa-93ed427b48fb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 200 len: 1335 microversion: 2.1 time: 0.110559 Oct 17 18:01:43.329836 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 338/689] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:43 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:01:43.620807 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:43.621573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:43.628747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:43.629367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:43.630202 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:43.631183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:43.631846 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:43.632492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:43.666966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:43.667475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:43.667898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:43.668528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid b9579f87-21e4-4c60-9ac5-3202aff271d7 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:43.710392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:43.717452 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-073ebd8e-6474-416b-a42b-7dcc09c2f5a8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 200 len: 1331 microversion: 2.1 time: 0.103859 Oct 17 18:01:43.718022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 352/690] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:43 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:44.351262 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:44.351881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 62268bc4-006f-4d44-a766-5930b2cca957] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:44.358305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:44.358779 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:44.359207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:44.359884 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:44.360331 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:44.360784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:44.373813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] HTTP exception thrown: Instance 62268bc4-006f-4d44-a766-5930b2cca957 could not be found. Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Request method failure captured: Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 HTTP/1.1 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZc_LxtLnNF4-kOQ9U7p3o6IbidtToA8RcEcFI97Euc4n3M7A-xl1inD5QCE4jmsvUxd0homtc0JQXQtgUegBvwsJDFRhnk-4tfJjfLULjHqfHcNQ_tgPj1PVVrqB3-2GHjJEAZksdYwhTNriz4gzz1Rm-OfpyeTm8rPT_1Sd5nSiS0 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:01:44.375430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54dacea98b1448ab828595f9e1c31a13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}] Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: af69042a7ac34adb92bae0288e51aa76 Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 62268bc4-006f-4d44-a766-5930b2cca957 could not be found. Oct 17 18:01:44.377139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '62268bc4-006f-4d44-a766-5930b2cca957'} Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62268bc4-006f-4d44-a766-5930b2cca957 could not be found. Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:44.378214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62268bc4-006f-4d44-a766-5930b2cca957 could not be found. Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62268bc4-006f-4d44-a766-5930b2cca957 could not be found. Oct 17 18:01:44.379729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.381099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Returning 404 to user: Instance 62268bc4-006f-4d44-a766-5930b2cca957 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:44.381099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e27faa7c-d127-4653-b2a4-d709677cc352 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957" status: 404 len: 111 microversion: 2.1 time: 0.029459 Oct 17 18:01:44.381099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 339/691] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:44 2022] GET /compute/v2.1/servers/62268bc4-006f-4d44-a766-5930b2cca957 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:01:44.385559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7bcaa981-f102-468d-b7b6-8c7d279a1dcb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '.version_select at 0x7f0196187ca0>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:44.491068 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7bcaa981-f102-468d-b7b6-8c7d279a1dcb tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-430901430" status: 202 len: 0 microversion: 2.1 time: 0.109348 Oct 17 18:01:44.491590 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 353/692] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:01:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-430901430 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:01:44.605959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-279185fc-3018-4ef7-b04e-b5db61fa586d req-f92e5035-af13-48ab-a098-25a05bca4dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9579f87-21e4-4c60-9ac5-3202aff271d7", "name": "network-vif-deleted", "tag": "5954f595-71d8-46d9-9be9-68b7ea32dffb"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:44.615232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-279185fc-3018-4ef7-b04e-b5db61fa586d req-f92e5035-af13-48ab-a098-25a05bca4dff service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:44.615701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-279185fc-3018-4ef7-b04e-b5db61fa586d req-f92e5035-af13-48ab-a098-25a05bca4dff service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:44.616126 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-279185fc-3018-4ef7-b04e-b5db61fa586d req-f92e5035-af13-48ab-a098-25a05bca4dff service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:44.627731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-279185fc-3018-4ef7-b04e-b5db61fa586d req-f92e5035-af13-48ab-a098-25a05bca4dff service nova] Creating event network-vif-deleted:5954f595-71d8-46d9-9be9-68b7ea32dffb for instance b9579f87-21e4-4c60-9ac5-3202aff271d7 on hv-cinder-86160 Oct 17 18:01:44.632783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-279185fc-3018-4ef7-b04e-b5db61fa586d req-f92e5035-af13-48ab-a098-25a05bca4dff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030551 Oct 17 18:01:44.633533 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 340/693] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:44.742303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:44.742843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:44.749284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:44.749771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:44.750196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:44.751060 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:44.751508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:44.751943 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:44.766593 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 HTTP/1.1 Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:01:44.768424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:01:44.770079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'b9579f87-21e4-4c60-9ac5-3202aff271d7'} Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:44.771016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:01:44.772465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:01:44.773830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:44.773830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c0c02529-7131-43d4-9c54-c17424d37810 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 404 len: 111 microversion: 2.1 time: 0.032083 Oct 17 18:01:44.773996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 354/694] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:44 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:01:44.779752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-212e56f7-262f-4334-99a8-81b2ce0efb67 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '.version_select at 0x7f0196206670>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:44.851492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-212e56f7-262f-4334-99a8-81b2ce0efb67 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497316928" status: 202 len: 0 microversion: 2.1 time: 0.075912 Oct 17 18:01:44.861521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 341/695] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:01:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497316928 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:01:45.692013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b7524646-5ce5-451b-8293-652b5be46824 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: .version_select at 0x7f01961a2af0>, body: {"keypair": {"name": "tempest-keypair-608074087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVPso50bfNZpNRIVwPBCB0Ihya5P2bJAQtvZ9/WBSs0Kvgbqetis59EFCgpunu2EbZLs2DOY0B+4kPH3oIZoJ9s8ByWMKyZjj180mbrcZg4Ax09P90IEewXlcs06/3xxQ=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:45.707959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-b7524646-5ce5-451b-8293-652b5be46824 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:01:45.711923 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-b7524646-5ce5-451b-8293-652b5be46824 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:01:45.829024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b7524646-5ce5-451b-8293-652b5be46824 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141013 Oct 17 18:01:45.829688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 355/696] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 18:01:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:47.886035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:47.886035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:47.890707 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:47.891197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:47.891634 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:47.892329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:47.892842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:47.893280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:47.918626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:01:48.187675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-81e2f37f-6c4c-4f9b-952b-4ec569c0b9a1 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 204 len: 0 microversion: 2.1 time: 0.308791 Oct 17 18:01:48.188273 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 342/697] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:01:47 2022] DELETE /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:01:48.196665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:48.197270 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:48.205275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:48.207162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:48.207162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:48.207162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:48.207469 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:48.207791 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:48.336577 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310442365", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a6940ab-f26f-4946-9f58-3b74b9998843"}], "security_groups": [{"name": "tempest-securitygroup--450502582"}], "key_name": "tempest-keypair-608074087", "user_data": "}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:48.346701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:48.354522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e79f4dac-b7c8-43ec-8813-a502bb55b9d2 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1508 microversion: 2.1 time: 0.162144 Oct 17 18:01:48.355118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 356/698] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:48 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:48.440890 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] validate_networks() for [('7a6940ab-f26f-4946-9f58-3b74b9998843', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:01:48.900194 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:01:48.905812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:01:48.905812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:01:48.905812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:01:48.905812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:01:48.911425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:48.911928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:48.912360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:48.913117 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:48.913566 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:48.913994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:48.933569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:01:48.937498 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Getting quotas for user db3c14157b684187bb00f5a42be62fed and project f7b0aca8f07d4eae89d9b8ed8abea1bf. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:01:48.948171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:01:48.951112 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:01:49.070980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-625c4e2c-87b7-4b8a-a179-a416cbc3b2e2 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.739156 Oct 17 18:01:49.071629 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 343/699] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:01:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 18:01:49.083593 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5f2c6dcb-ea61-4631-804a-9423fa1626bc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:49.084189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5f2c6dcb-ea61-4631-804a-9423fa1626bc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:49.138518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5f2c6dcb-ea61-4631-804a-9423fa1626bc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:49.146104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5f2c6dcb-ea61-4631-804a-9423fa1626bc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1240 microversion: 2.1 time: 0.066464 Oct 17 18:01:49.146765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 357/700] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:49 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:49.378359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:49.381591 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:49.385122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:49.385601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:49.386039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:49.386726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:49.387184 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:49.387613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:49.525551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:49.533601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-335e98bd-7d2f-4081-9742-5fa023863429 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1508 microversion: 2.1 time: 0.159167 Oct 17 18:01:49.534365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 344/701] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:49 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:50.168897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:50.172132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:50.177328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:50.177813 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:50.178250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:50.179072 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:50.179475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:50.179899 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:50.253084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:50.260766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5f9f40be-e631-4478-9ddb-1f66b9e556d9 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1244 microversion: 2.1 time: 0.095777 Oct 17 18:01:50.261332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 358/702] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:50 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:01:50.559709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:50.560746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:50.572218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:50.573090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:50.575476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:50.575476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:50.578967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:50.579863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:50.667487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-26ba94bd-b27e-4493-bd5f-3084a04b84ff req-debfee3a-2fd0-4574-9b84-35a2b18860ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d9533e-9953-4305-87cb-374cd49a00fc", "name": "network-vif-deleted", "tag": "ab4d8739-36f3-4abd-a9e7-82aaa2a2076d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:50.676789 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:50.678107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-26ba94bd-b27e-4493-bd5f-3084a04b84ff req-debfee3a-2fd0-4574-9b84-35a2b18860ce service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:50.679040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-26ba94bd-b27e-4493-bd5f-3084a04b84ff req-debfee3a-2fd0-4574-9b84-35a2b18860ce service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:50.679826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-26ba94bd-b27e-4493-bd5f-3084a04b84ff req-debfee3a-2fd0-4574-9b84-35a2b18860ce service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:50.686232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-365b1116-7c07-4f9d-8afa-583855e952db tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1466 microversion: 2.1 time: 0.132278 Oct 17 18:01:50.692102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-26ba94bd-b27e-4493-bd5f-3084a04b84ff req-debfee3a-2fd0-4574-9b84-35a2b18860ce service nova] Creating event network-vif-deleted:ab4d8739-36f3-4abd-a9e7-82aaa2a2076d for instance 46d9533e-9953-4305-87cb-374cd49a00fc on hv-cinder-86160 Oct 17 18:01:50.697589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-26ba94bd-b27e-4493-bd5f-3084a04b84ff req-debfee3a-2fd0-4574-9b84-35a2b18860ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033215 Oct 17 18:01:50.700891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 359/703] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:01:50.704876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 345/704] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:50 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:51.286650 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:51.287438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:51.293376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:51.293854 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:51.294284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:51.294966 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:51.295412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:51.295831 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:51.392692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:51.400727 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c2797495-c03e-4ce3-9e19-07732418442f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1300 microversion: 2.1 time: 0.118593 Oct 17 18:01:51.401332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 360/705] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:51 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:01:51.710052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:51.710829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:51.717434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:51.718089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:51.718530 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:51.719304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:51.719762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:51.720187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:51.753926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:51.754410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:51.755488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:51.755488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'fault' on Instance uuid 46d9533e-9953-4305-87cb-374cd49a00fc {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:51.824156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:51.833601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-035297ee-da9f-4a6c-9849-ee25d484aeac tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 200 len: 1311 microversion: 2.1 time: 0.127317 Oct 17 18:01:51.834287 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 346/706] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:51 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:52.426324 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:52.427107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:52.437078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:52.437078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:52.437078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:52.437381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:52.437764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:52.438197 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:52.586568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:52.596954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-743decc1-ae75-4e75-8e36-1e92859f6848 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.174646 Oct 17 18:01:52.597539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 361/707] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:52 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:52.856809 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:52.857446 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: 46d9533e-9953-4305-87cb-374cd49a00fc] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:52.864711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:52.865202 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:52.865642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:52.866350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:52.866813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:52.867244 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:52.881916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] HTTP exception thrown: Instance 46d9533e-9953-4305-87cb-374cd49a00fc could not be found. Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Request method failure captured: Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc HTTP/1.1 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZc_LxtLnNF4-kOQ9U7p3o6IbidtToA8RcEcFI97Euc4n3M7A-xl1inD5QCE4jmsvUxd0homtc0JQXQtgUegBvwsJDFRhnk-4tfJjfLULjHqfHcNQ_tgPj1PVVrqB3-2GHjJEAZksdYwhTNriz4gzz1Rm-OfpyeTm8rPT_1Sd5nSiS0 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:01:52.883578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54dacea98b1448ab828595f9e1c31a13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}] Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: af69042a7ac34adb92bae0288e51aa76 Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 46d9533e-9953-4305-87cb-374cd49a00fc could not be found. Oct 17 18:01:52.891291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '46d9533e-9953-4305-87cb-374cd49a00fc'} Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d9533e-9953-4305-87cb-374cd49a00fc could not be found. Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:52.892166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d9533e-9953-4305-87cb-374cd49a00fc could not be found. Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d9533e-9953-4305-87cb-374cd49a00fc could not be found. Oct 17 18:01:52.893676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:52.894984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Returning 404 to user: Instance 46d9533e-9953-4305-87cb-374cd49a00fc could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:52.894984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2790ce76-a8ae-4410-90e1-c8247583fb4d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc" status: 404 len: 111 microversion: 2.1 time: 0.032085 Oct 17 18:01:52.894984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 347/708] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:52 2022] GET /compute/v2.1/servers/46d9533e-9953-4305-87cb-374cd49a00fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:01:52.897020 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:52.897511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:52.903348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:52.903828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:52.904261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:52.905061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:52.905509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:52.905928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:52.932818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:01:53.169218 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-33015b2c-1852-4e28-9e12-ef468459599c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 204 len: 0 microversion: 2.1 time: 0.275587 Oct 17 18:01:53.169895 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 362/709] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:01:52 2022] DELETE /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:01:53.178250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:53.178856 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:53.185749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:53.186196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:53.186623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:53.187470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:53.187922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:53.188370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:53.366915 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:53.375028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3e394abc-2d32-46be-9613-1e964d7e00a4 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.200502 Oct 17 18:01:53.375594 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 348/710] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:53 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:01:53.433351 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-a867a4b2-6e6b-407a-97f1-180952f0f0bc req-9d7616fe-a2a0-4550-b8d8-32be9da96e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4ff70-3471-4260-b4d4-528b64caf25e", "tag": "39ad0571-44f9-4cd9-950c-cae84df52bb7"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:53.443694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a867a4b2-6e6b-407a-97f1-180952f0f0bc req-9d7616fe-a2a0-4550-b8d8-32be9da96e8f service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:53.444093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a867a4b2-6e6b-407a-97f1-180952f0f0bc req-9d7616fe-a2a0-4550-b8d8-32be9da96e8f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:53.444512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a867a4b2-6e6b-407a-97f1-180952f0f0bc req-9d7616fe-a2a0-4550-b8d8-32be9da96e8f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:53.457306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-a867a4b2-6e6b-407a-97f1-180952f0f0bc req-9d7616fe-a2a0-4550-b8d8-32be9da96e8f service nova] Creating event network-changed:39ad0571-44f9-4cd9-950c-cae84df52bb7 for instance 93a4ff70-3471-4260-b4d4-528b64caf25e on hv-cinder-86160 Oct 17 18:01:53.462236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-a867a4b2-6e6b-407a-97f1-180952f0f0bc req-9d7616fe-a2a0-4550-b8d8-32be9da96e8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033881 Oct 17 18:01:53.462821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 363/711] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:01:53.621116 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:53.621727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:53.628066 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:53.628548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:53.629040 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:53.629739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:53.630187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:53.630611 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:53.756576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:53.764289 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e6010169-b303-4046-bcc2-174ad5547690 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.146942 Oct 17 18:01:53.765442 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 349/712] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:53 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:54.399266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:54.399947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:54.406806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:54.407275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:54.407703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:54.408376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:54.408842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:54.409259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:54.539748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:54.547996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cec0c0b2-422c-4bd9-89ed-91f5ec1e970d tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.152884 Oct 17 18:01:54.548568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 364/713] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:54 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:54.787550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:54.788157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:54.794657 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:54.795127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:54.796305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:54.797018 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:54.797467 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:54.797887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:54.925733 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:54.933920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-32c00987-c9a3-433f-907e-68afe9b444f4 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.150124 Oct 17 18:01:54.934495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 350/714] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:54 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:55.571168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:55.571778 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:55.578282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:55.578758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:55.579193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:55.579909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:55.580356 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:55.580814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:55.777316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:55.785023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4431813d-d900-468c-8b8b-749c96ae617b tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1521 microversion: 2.1 time: 0.217867 Oct 17 18:01:55.785610 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 365/715] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:55 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:55.957503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:55.958109 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:55.964450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:55.964956 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:55.965384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:55.966069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:55.966514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:55.966938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:56.266941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:56.274753 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f556ecda-91d4-437c-b854-4070e2e2f10a tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.321077 Oct 17 18:01:56.275354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 351/716] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:55 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:56.474936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:56.475434 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:56.481407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:56.481889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:56.482316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:56.483925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:56.484390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:56.484871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:56.509864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ec9017f7-aa8d-4b55-a526-d573026d0d6d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/ips" status: 200 len: 152 microversion: 2.20 time: 0.146473 Oct 17 18:01:56.510420 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 366/717] 10.222.0.58 () {60 vars in 1289 bytes} [Mon Oct 17 18:01:56 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/ips => generated 152 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:01:56.728657 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-c40d17f5-4925-4769-90f4-6a0709660ebb req-2565b0df-5ac4-4129-bde1-22ec61241074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba64c9aa-8ed7-4020-8fcb-90e39eab659b", "name": "network-vif-deleted", "tag": "d087c949-77fc-498e-902d-36ca8ef2c433"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:56.739226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c40d17f5-4925-4769-90f4-6a0709660ebb req-2565b0df-5ac4-4129-bde1-22ec61241074 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:56.739780 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c40d17f5-4925-4769-90f4-6a0709660ebb req-2565b0df-5ac4-4129-bde1-22ec61241074 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:56.740275 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c40d17f5-4925-4769-90f4-6a0709660ebb req-2565b0df-5ac4-4129-bde1-22ec61241074 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:56.752535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-c40d17f5-4925-4769-90f4-6a0709660ebb req-2565b0df-5ac4-4129-bde1-22ec61241074 service nova] Creating event network-vif-deleted:d087c949-77fc-498e-902d-36ca8ef2c433 for instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b on hv-cinder-86160 Oct 17 18:01:56.757477 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-c40d17f5-4925-4769-90f4-6a0709660ebb req-2565b0df-5ac4-4129-bde1-22ec61241074 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034516 Oct 17 18:01:56.758063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 352/718] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:01:56.807614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:56.808213 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:56.815453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:56.815946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:56.816370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:56.817088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:56.817536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:56.817957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:56.882085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:56.890293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4be7e8c7-9ca4-410c-a6f4-3f93d60726a5 tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1479 microversion: 2.1 time: 0.086888 Oct 17 18:01:56.891025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 367/719] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:56 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:57.300278 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:57.300999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:57.307319 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:57.307790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:57.308218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:57.308930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:57.309384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:57.309800 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:57.440453 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:57.447963 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-df6c76c5-0667-4d77-bd83-e6d12079c52b tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.152640 Oct 17 18:01:57.448526 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 353/720] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:57 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:57.913691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:57.914296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:57.921405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:57.921975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:57.924103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:57.924103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:57.924103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:57.924103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:57.956899 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:57.957384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:57.957911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:57.958357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lazy-loading 'fault' on Instance uuid ba64c9aa-8ed7-4020-8fcb-90e39eab659b {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:57.961412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:58.001187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af69042a7ac34adb92bae0288e51aa76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dacea98b1448ab828595f9e1c31a13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:58.008751 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e8ec75f0-2afa-4187-8c20-591138962ecc tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 200 len: 1311 microversion: 2.1 time: 0.098935 Oct 17 18:01:58.009310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 368/721] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:57 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:58.471548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:58.472163 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:58.478612 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:58.479142 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:58.479581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:58.480309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:58.480867 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:58.481364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:58.558437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:01:58.558875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:58.566641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:58.567125 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:58.567722 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:58.568410 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:58.568876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:58.569287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:58.594157 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lazy-loading 'flavor' on Instance uuid 907637d1-192e-4a1a-8925-86218c9015a5 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:01:58.617142 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:58.625396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7d343572-80e0-4dbf-a0b8-40d3a13019b0 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.157200 Oct 17 18:01:58.625972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 354/722] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:58 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:01:59.032886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:59.033493 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] [instance: ba64c9aa-8ed7-4020-8fcb-90e39eab659b] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:59.035408 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:59.039294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:59.040987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:59.041473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:59.041907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:59.042603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:59.043061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:59.043488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:59.050679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b7a5d8d7-1a17-4943-b010-c4f27c45b000 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/action" status: 202 len: 0 microversion: 2.20 time: 0.497970 Oct 17 18:01:59.052201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 369/723] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 17 18:01:58 2022] POST /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 18:01:59.061506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:59.062644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:59.064226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] HTTP exception thrown: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b could not be found. Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Request method failure captured: Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b HTTP/1.1 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZc_LxtLnNF4-kOQ9U7p3o6IbidtToA8RcEcFI97Euc4n3M7A-xl1inD5QCE4jmsvUxd0homtc0JQXQtgUegBvwsJDFRhnk-4tfJjfLULjHqfHcNQ_tgPj1PVVrqB3-2GHjJEAZksdYwhTNriz4gzz1Rm-OfpyeTm8rPT_1Sd5nSiS0 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:01:59.065919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_54dacea98b1448ab828595f9e1c31a13", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/54dacea98b1448ab828595f9e1c31a13"}]}] Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 54dacea98b1448ab828595f9e1c31a13 Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-717433367 Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: af69042a7ac34adb92bae0288e51aa76 Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-ServerRescueNegativeTestJSON-717433367-project Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b could not be found. Oct 17 18:01:59.067593 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'ba64c9aa-8ed7-4020-8fcb-90e39eab659b'} Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b could not be found. Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:01:59.068727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b could not be found. Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b could not be found. Oct 17 18:01:59.070235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:01:59.071716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] Returning 404 to user: Instance ba64c9aa-8ed7-4020-8fcb-90e39eab659b could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:01:59.071716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9b866982-5071-4085-bec5-5f1c7fe7956c tempest-ServerRescueNegativeTestJSON-717433367 tempest-ServerRescueNegativeTestJSON-717433367-project] 10.222.0.58 "GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b" status: 404 len: 111 microversion: 2.1 time: 0.038928 Oct 17 18:01:59.071716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 355/724] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:59 2022] GET /compute/v2.1/servers/ba64c9aa-8ed7-4020-8fcb-90e39eab659b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 18:01:59.073762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:59.073762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:59.073762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:59.074302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:59.074745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:59.075160 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:59.143694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:01:59.254797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:59.262886 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:59.264337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:01:59.266166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-edecd307-b8b1-4480-b85d-fefed866e4bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.208913 Oct 17 18:01:59.266739 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 370/725] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:01:59 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:01:59.655546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:01:59.657322 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:01:59.665450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:59.665932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:59.666359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:59.667057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:01:59.667506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:01:59.667926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:01:59.689685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:00.008966 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:00.017759 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-68d794b2-b06c-42d1-ad2b-91c75be172aa tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.366084 Oct 17 18:02:00.018334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 356/726] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:01:59 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:00.292617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:00.293802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:00.301856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:00.302344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:00.302814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:00.303520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:00.303965 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:00.304384 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:00.472914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:00.482272 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:00.484680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:00.486006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-81a14fda-8803-4070-a4c2-0a7f44ef2329 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.197392 Oct 17 18:02:00.487010 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 371/727] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:00 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:01.042395 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:01.043856 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:01.050961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:01.051695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:01.052135 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:01.052866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:01.053321 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:01.053744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:01.210097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:01.218351 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d9b07ec7-ef29-4c6f-9674-7b87ce4e1382 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.179562 Oct 17 18:02:01.218895 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 357/728] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:01 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:01.514896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:01.517439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:01.525393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:01.526387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:01.526857 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:01.528189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:01.528785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:01.529307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:01.684851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:01.694676 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:01.696103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:01.697277 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6dc87677-aedd-4d6d-a312-67afcc496843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.186846 Oct 17 18:02:01.698814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 372/729] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:01 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:02.229674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-fda6476a-57af-473e-a95a-3d9030a27adb req-73a7892b-c9a3-4b41-b0bb-946aee70ea8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4ff70-3471-4260-b4d4-528b64caf25e", "name": "network-vif-plugged", "status": "completed", "tag": "39ad0571-44f9-4cd9-950c-cae84df52bb7"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:02.235829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:02.239676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-fda6476a-57af-473e-a95a-3d9030a27adb req-73a7892b-c9a3-4b41-b0bb-946aee70ea8b service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:02.240157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-fda6476a-57af-473e-a95a-3d9030a27adb req-73a7892b-c9a3-4b41-b0bb-946aee70ea8b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:02.240582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-fda6476a-57af-473e-a95a-3d9030a27adb req-73a7892b-c9a3-4b41-b0bb-946aee70ea8b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:02.244352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:02.245265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:02.252674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-fda6476a-57af-473e-a95a-3d9030a27adb req-73a7892b-c9a3-4b41-b0bb-946aee70ea8b service nova] Creating event network-vif-plugged:39ad0571-44f9-4cd9-950c-cae84df52bb7 for instance 93a4ff70-3471-4260-b4d4-528b64caf25e on hv-cinder-86160 Oct 17 18:02:02.252840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:02.253419 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:02.253945 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:02.254715 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:02.255239 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:02.255731 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:02.257665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-fda6476a-57af-473e-a95a-3d9030a27adb req-73a7892b-c9a3-4b41-b0bb-946aee70ea8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091119 Oct 17 18:02:02.258605 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 358/730] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:02.397007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:02.405026 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7f1c559f-ab39-4529-91aa-f3bd3effc3cc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.164873 Oct 17 18:02:02.405598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 373/731] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:02 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:02.724920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:02.725715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:02.732855 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:02.733356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:02.734070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:02.735697 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:02.736242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:02.737577 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:02.896242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:02.905829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:02.907302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:02.908542 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bcb3a77d-cf69-48fe-a4cb-0e4da0e74214 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.190281 Oct 17 18:02:02.909148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 359/732] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:02 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:03.429069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:03.429681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:03.436390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:03.436910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:03.437393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:03.438118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:03.438568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:03.438993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:03.583035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:03.591254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b2771d5a-9ee0-4ecb-9356-79deb0fcbb77 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1365 microversion: 2.1 time: 0.166025 Oct 17 18:02:03.591948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 374/733] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:03 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:03.934943 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:03.935548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:03.942425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:03.942901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:03.943331 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:03.944008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:03.944513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:03.944978 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:04.098666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:04.106984 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:04.108434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:04.109853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-86250136-f4b2-4bc7-b573-1c84aef37ada tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.179062 Oct 17 18:02:04.110415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 360/734] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:03 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:04.615779 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:04.616387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:04.622737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:04.629156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:04.629156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:04.629156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:04.629156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:04.629541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:04.761083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:04.766830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-feda902f-92b2-4c45-86e4-a5eed6da8696 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1555 microversion: 2.1 time: 0.154893 Oct 17 18:02:04.767580 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 375/735] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:04 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:04.788780 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:04.790908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:04.795012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:04.795517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:04.795916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:04.796762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:04.797252 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:04.797783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:04.878747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9276eb84-f183-4747-9472-3a0a8384b53c tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092732 Oct 17 18:02:04.878747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 361/736] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 18:02:04 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:05.136245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:05.136800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:05.142797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:05.146427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:05.146427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:05.146427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:05.146427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:05.146786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:05.427542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:05.436634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:05.438134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:05.440242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-91d6f640-ef76-4cef-941a-cd7aa399b157 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.307196 Oct 17 18:02:05.440870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 376/737] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:05 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:05.926425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:05.927489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:05.939840 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:05.940806 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:05.941812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:05.944473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:05.946450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:05.947189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:05.995076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-cfda9e8f-8913-4198-aeac-89660584f08f req-d47c0d95-1be2-4dc1-b5bd-437d4e44a45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4ff70-3471-4260-b4d4-528b64caf25e", "tag": "39ad0571-44f9-4cd9-950c-cae84df52bb7"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:06.042092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-cfda9e8f-8913-4198-aeac-89660584f08f req-d47c0d95-1be2-4dc1-b5bd-437d4e44a45a service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:06.042820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-cfda9e8f-8913-4198-aeac-89660584f08f req-d47c0d95-1be2-4dc1-b5bd-437d4e44a45a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:06.043594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-cfda9e8f-8913-4198-aeac-89660584f08f req-d47c0d95-1be2-4dc1-b5bd-437d4e44a45a service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:06.054072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:02:06.059653 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-cfda9e8f-8913-4198-aeac-89660584f08f req-d47c0d95-1be2-4dc1-b5bd-437d4e44a45a service nova] Creating event network-changed:39ad0571-44f9-4cd9-950c-cae84df52bb7 for instance 93a4ff70-3471-4260-b4d4-528b64caf25e on hv-cinder-86160 Oct 17 18:02:06.065076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-cfda9e8f-8913-4198-aeac-89660584f08f req-d47c0d95-1be2-4dc1-b5bd-437d4e44a45a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078304 Oct 17 18:02:06.065674 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 377/738] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:06.315056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-32c22136-037c-4724-97cf-d6ef19f5139d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 204 len: 0 microversion: 2.1 time: 0.399328 Oct 17 18:02:06.316748 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 362/739] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:02:05 2022] DELETE /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:02:06.326347 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:06.327070 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:06.335269 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:06.335787 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:06.336223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:06.336944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:06.337427 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:06.337881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:06.466417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:06.467532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:06.474139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:06.474787 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:06.475332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:06.476142 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:06.476797 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:06.477457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:06.504924 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:06.513182 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9fb8b8a4-4049-45e9-a09c-a72e5551c7cd tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1577 microversion: 2.1 time: 0.191069 Oct 17 18:02:06.514007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 378/740] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:06 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:06.624169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:06.633568 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:06.635496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:06.636847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-32a5ca22-cc81-483e-ba69-43ab41b4c1e4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.174910 Oct 17 18:02:06.637736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 363/741] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:06 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:07.542909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:07.544843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:07.553115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:07.553948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:07.554549 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:07.556967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:07.558561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:07.558863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:07.667835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:07.675088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:07.686039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:07.687031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:07.688043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:07.689700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:07.690917 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:07.691600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:07.920429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:07.931547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1bf88668-a0f9-4f35-9996-5e3cffd81f09 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1577 microversion: 2.1 time: 0.393719 Oct 17 18:02:07.955407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:07.955765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 379/742] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:07 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1577 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:07.955902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:07.955902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:07.956735 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e5e50546-2acc-429f-bc57-e09961cf3924 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.294991 Oct 17 18:02:07.957294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 364/743] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:07 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:08.956681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:08.957914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:08.966795 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:08.970249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:08.970249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:08.970811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:08.971287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:08.971798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:08.984949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:08.985560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:09.001838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:09.003386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:09.004026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:09.006259 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:09.006558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:09.013669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:09.107994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:09.120162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-26ae6989-796b-4333-8c8e-98b568e36b1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1510 microversion: 2.1 time: 0.168525 Oct 17 18:02:09.121497 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 380/744] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:08 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:09.304853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:09.316058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:09.318034 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:09.320067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fb517a66-4625-4b80-bd46-b968ecb6c424 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.341416 Oct 17 18:02:09.334118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 365/745] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:08 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:09.524630 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-d62ab8ea-a715-4740-9c57-1506a17be947 req-089a0f8e-ad58-4492-93e0-662ddbab1d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aed4c63-5f40-4c41-b922-937d81e91fab", "name": "network-vif-deleted", "tag": "23346adb-7974-40d2-8c58-f9c6a1e063fa"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:09.542743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d62ab8ea-a715-4740-9c57-1506a17be947 req-089a0f8e-ad58-4492-93e0-662ddbab1d2d service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:09.543218 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d62ab8ea-a715-4740-9c57-1506a17be947 req-089a0f8e-ad58-4492-93e0-662ddbab1d2d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:09.551235 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d62ab8ea-a715-4740-9c57-1506a17be947 req-089a0f8e-ad58-4492-93e0-662ddbab1d2d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:09.587439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-d62ab8ea-a715-4740-9c57-1506a17be947 req-089a0f8e-ad58-4492-93e0-662ddbab1d2d service nova] Creating event network-vif-deleted:23346adb-7974-40d2-8c58-f9c6a1e063fa for instance 0aed4c63-5f40-4c41-b922-937d81e91fab on hv-cinder-86160 Oct 17 18:02:09.603808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-d62ab8ea-a715-4740-9c57-1506a17be947 req-089a0f8e-ad58-4492-93e0-662ddbab1d2d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083289 Oct 17 18:02:09.605315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 381/746] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:10.144694 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:10.145308 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:10.156078 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:10.156708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:10.157216 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:10.157925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:10.158391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:10.158799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:10.269056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:10.283397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-41cfc0f3-727a-4c71-8530-1d6a926b11aa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 200 len: 1225 microversion: 2.1 time: 0.136259 Oct 17 18:02:10.283397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 366/747] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:10 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:10.349503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:10.350926 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:10.357397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:10.359964 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:10.360666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:10.365935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:10.365935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:10.365935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:10.554358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:10.563551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:10.565134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:10.566560 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-87a3b8ec-622d-4587-bb6d-45da7159ecd7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.222083 Oct 17 18:02:10.567683 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 382/748] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:10 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:11.304572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:11.305209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:11.311592 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:11.312891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:11.314634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:11.314634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:11.314840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:11.315187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:11.321367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-881577f7-1aee-4bd8-9ecd-ffe7271a1912 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: .version_select at 0x7f0199a95280>, body: {"keypair": {"name": "tempest-keypair-172755316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHprNMk07cOVqjRKKVrfMV26InKZ4HIvloTfn0RSOrdZOzCeoSDJsRe3xbfdZl8hVr/E16xqO/ZBWhzwrG+0/SJlIqCLB6XsbUsTb0fOqCRm5bST5Az6ecI1JOnMgs47Qg=="}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:11.330760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] HTTP exception thrown: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Request method failure captured: Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab HTTP/1.1 Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZezxJ-aFNqAiu7NbKAfP-V9SDsvbiBfuGLm0TjGHTRy_XFrq4kAtgKkV2XiV7xKHcYYAnstrFpBBbmXzY39WDYFY_7Xp5b69AmtYlfoJNRvEnQcm49YqgausAQoO_BkmDzOYuLVUR1lSEbx69BTvzblL4RybT6LmtW3ag_g7uRZYbg Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:02:11.332557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1c70a04a649248c6a629325d44c380b9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}] Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: ec7790cac2cb4e7cb68b5a2e3a91d5ec Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:02:11.333961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '0aed4c63-5f40-4c41-b922-937d81e91fab'} Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:02:11.334756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:02:11.336002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:02:11.337191 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Returning 404 to user: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:02:11.337191 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cd346072-233d-4d5e-916d-d15a7858ec1c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 404 len: 111 microversion: 2.1 time: 0.033210 Oct 17 18:02:11.337191 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 383/749] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:11 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 18:02:11.349614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-881577f7-1aee-4bd8-9ecd-ffe7271a1912 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:02:11.353837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-881577f7-1aee-4bd8-9ecd-ffe7271a1912 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for user b77324aa35534726b030564b5b70fb22 and project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:02:11.441121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-881577f7-1aee-4bd8-9ecd-ffe7271a1912 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249694 Oct 17 18:02:11.442961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 367/750] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 18:02:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:11.445742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1457462372", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1896343550", "security_groups": [{"name": "tempest-secgroup-smoke-490657498"}], "block_device_mapping_v2": [{"uuid": "c34e62df-9f65-47b6-848b-fae4c16afd56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5134453-24e2-45e3-8067-3e320705eb69"}]}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:11.594000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:11.594980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:11.607905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] validate_networks() for [('a5134453-24e2-45e3-8067-3e320705eb69', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:02:11.614028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:11.614850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:11.615563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:11.617104 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:11.617756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:11.618664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:11.828676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:11.837097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:11.838576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:11.839757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f5ec0f30-27f5-41f5-a1ce-e61fe17d4bd6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.251123 Oct 17 18:02:11.840326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 368/751] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:11 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:12.151043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:02:12.151483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:02:12.151986 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:02:12.152374 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:02:12.152804 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:02:12.156134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:12.163797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:12.164276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:12.164733 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:12.165648 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:12.166092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:12.166511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:12.188315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for project 1c70a04a649248c6a629325d44c380b9. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:02:12.193670 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for user ec7790cac2cb4e7cb68b5a2e3a91d5ec and project 1c70a04a649248c6a629325d44c380b9. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:02:12.256257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:02:12.258513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c34e62df-9f65-47b6-848b-fae4c16afd56',volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:02:12.682714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-73051177-7d4c-4a8a-bec5-05e376acde9e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.242899 Oct 17 18:02:12.693392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 384/752] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:02:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:02:12.695451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-74ed2d4c-9dec-48bd-a306-6ec84bace0e0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:12.696068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-74ed2d4c-9dec-48bd-a306-6ec84bace0e0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:12.759134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-74ed2d4c-9dec-48bd-a306-6ec84bace0e0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:12.767633 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-74ed2d4c-9dec-48bd-a306-6ec84bace0e0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1095 microversion: 2.1 time: 0.076114 Oct 17 18:02:12.773504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 369/753] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:12 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:12.867889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:12.868680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:12.883704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:12.884267 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:12.884797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:12.887171 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:12.887705 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:12.889479 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:13.066814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:13.070287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:13.075368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:13.076871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:13.078606 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9dd87904-17ab-4596-8e91-d6d94b1a2d4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.215265 Oct 17 18:02:13.079169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 385/754] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:12 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:13.791570 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:13.793009 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:13.799341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:13.799829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:13.800265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:13.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:13.801491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:13.801916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:13.871856 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:13.881928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bac90372-51d2-4bb3-8274-861f80aaa9fa tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1145 microversion: 2.1 time: 0.094170 Oct 17 18:02:13.882350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 370/755] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:13 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:13.901370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-345665217", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e8887de-6e79-4183-8b8b-78a219ef29bb"}], "security_groups": [{"name": "tempest-securitygroup--1884082610"}], "key_name": "tempest-keypair-172755316", "user_data": "}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:14.045532 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] validate_networks() for [('3e8887de-6e79-4183-8b8b-78a219ef29bb', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:02:14.104742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:14.105511 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:14.112480 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:14.113021 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:14.113460 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:14.114197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:14.114661 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:14.115111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:14.363644 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:14.373059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:14.375297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:14.376580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a5ac5233-df71-40f5-b4f3-87b33d92d641 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.275937 Oct 17 18:02:14.377245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 371/756] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:14 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:14.536546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:02:14.537041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:02:14.537545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:02:14.537996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:02:14.538418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:02:14.548175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:14.548575 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:14.549033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:14.549779 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:14.550229 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:14.550648 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:14.568787 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:02:14.572508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for user b77324aa35534726b030564b5b70fb22 and project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:02:14.585009 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:02:14.587223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:02:14.709271 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3451ea95-0fc7-4e95-918f-86d8a7976b1a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812951 Oct 17 18:02:14.714708 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 386/757] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:02:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:02:14.722932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-458599e9-6e4b-4804-9ee7-5f31e8c7cba7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:14.723680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-458599e9-6e4b-4804-9ee7-5f31e8c7cba7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:14.781770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-458599e9-6e4b-4804-9ee7-5f31e8c7cba7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:14.790158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-458599e9-6e4b-4804-9ee7-5f31e8c7cba7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1236 microversion: 2.1 time: 0.072461 Oct 17 18:02:14.806218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 372/758] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:14 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:14.906333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:14.907462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:14.914329 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:14.915647 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:14.916161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:14.917021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:14.917644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:14.918225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:14.991342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:14.999487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-05730432-eeda-4e07-99e9-485db7b7f84b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1193 microversion: 2.1 time: 0.097646 Oct 17 18:02:15.000104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 387/759] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:14 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:15.403238 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:15.404137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:15.415352 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:15.418887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:15.419581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:15.420309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:15.423637 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:15.424063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:15.580887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:15.589742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:15.591335 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:15.592488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-70d6e560-0124-447c-89a3-a1b88e6712fd tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1745 microversion: 2.20 time: 0.194119 Oct 17 18:02:15.593603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 373/760] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:15 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:15.815871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a5aff0cf-32d4-4df6-a659-4aade6c56e58 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:15.816863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a5aff0cf-32d4-4df6-a659-4aade6c56e58 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:15.914257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a5aff0cf-32d4-4df6-a659-4aade6c56e58 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:15.930405 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a5aff0cf-32d4-4df6-a659-4aade6c56e58 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1236 microversion: 2.1 time: 0.119385 Oct 17 18:02:15.931400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 388/761] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:15 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1236 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:16.025061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:16.025665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:16.032133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:16.032638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:16.033074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:16.034630 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:16.041028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:16.041028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:16.101440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:16.109906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-31b92045-b7bb-46fd-8501-88a5373d9cf1 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1211 microversion: 2.1 time: 0.088730 Oct 17 18:02:16.110474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 374/762] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:16 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:16.619622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:16.620340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:16.628368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:16.628969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:16.629468 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:16.630225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:16.630881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:16.631332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:16.842523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:16.847064 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:16.848524 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:16.849701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-73d54df3-4ce9-462f-934d-6305c17474a5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1745 microversion: 2.20 time: 0.233917 Oct 17 18:02:16.850260 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 389/763] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:16 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1745 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:16.968928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:16.968928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:16.968928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:16.968928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:16.969332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:16.969332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:16.969332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:16.969332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:16.986807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:17.049400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:17.057122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c657a78e-cfad-4595-8235-9528ca999ca6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1288 microversion: 2.1 time: 0.106647 Oct 17 18:02:17.057696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 375/764] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:16 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:17.137557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:17.138256 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:17.145466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:17.147441 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:17.147441 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:17.147742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:17.148264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:17.148741 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:17.328032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:17.336328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6b94dd91-6bff-4202-be79-ad96765e76d6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1278 microversion: 2.1 time: 0.205225 Oct 17 18:02:17.336907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 390/765] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:17 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:17.394021 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-363ddae3-6910-402b-a286-b13043776a1a req-8e691011-48d9-4ece-bcab-187901567da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949c71e4-fa50-47d6-ac7e-522194d40d7a", "tag": "0ad73db8-daee-4a82-827a-4ff8e9c3a0b6"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:17.404696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-363ddae3-6910-402b-a286-b13043776a1a req-8e691011-48d9-4ece-bcab-187901567da6 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:17.405908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-363ddae3-6910-402b-a286-b13043776a1a req-8e691011-48d9-4ece-bcab-187901567da6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:17.406646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-363ddae3-6910-402b-a286-b13043776a1a req-8e691011-48d9-4ece-bcab-187901567da6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:17.422927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-363ddae3-6910-402b-a286-b13043776a1a req-8e691011-48d9-4ece-bcab-187901567da6 service nova] Creating event network-changed:0ad73db8-daee-4a82-827a-4ff8e9c3a0b6 for instance 949c71e4-fa50-47d6-ac7e-522194d40d7a on hv-cinder-86160 Oct 17 18:02:17.428016 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-363ddae3-6910-402b-a286-b13043776a1a req-8e691011-48d9-4ece-bcab-187901567da6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044586 Oct 17 18:02:17.428802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 376/766] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:17.876837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:17.878321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:17.887774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:17.887774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:17.887774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:17.887774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:17.889128 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:17.890305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:18.082645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:18.083470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:18.091613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:18.092381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:18.093702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:18.094822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:18.095491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:18.096130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:18.141539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:18.155870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:18.162957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:18.165266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-aced8b84-4092-4c23-940f-1614eb0b0a4f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.293459 Oct 17 18:02:18.179631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 391/767] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:17 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:18.254060 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:18.263025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d29e32a4-3045-4464-9b24-62dbc3dc05be tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1294 microversion: 2.1 time: 0.185994 Oct 17 18:02:18.281452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 377/768] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:18 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1294 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:18.365124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:18.366045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:18.376777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:18.377323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:18.377766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:18.378596 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:18.379220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:18.379795 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:19.048552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:19.066472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9d92608c-d8a7-493f-8918-7fcc6e158370 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.710757 Oct 17 18:02:19.067614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 392/769] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:18 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:19.193818 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:19.195459 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:19.204048 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:19.205019 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:19.205758 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:19.206685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:19.207379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:19.208021 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:19.299938 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:19.302042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:19.313257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:19.315858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:19.315858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:19.318000 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:19.319098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:19.319738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:19.467159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:19.491437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:19.501894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:19.503697 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1cae67c4-db88-410c-add9-574494e3a1b3 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.315749 Oct 17 18:02:19.504379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 378/770] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:19 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:19.636916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:19.654138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-93927f01-ef33-4aca-8880-0d8c0d337af7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.369776 Oct 17 18:02:19.655185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 393/771] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:19 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:20.090243 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:20.093813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:20.105587 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.108208 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.109024 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.110005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.111544 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.112292 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.245249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-8ad3a5b8-2be2-48d7-80ca-1c113e3e0bc1 req-a5696fa5-aa74-4a0c-a1ae-db1bf9f7f0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "name": "network-vif-plugged", "status": "completed", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:20.259418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-8ad3a5b8-2be2-48d7-80ca-1c113e3e0bc1 req-a5696fa5-aa74-4a0c-a1ae-db1bf9f7f0de service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.259576 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-8ad3a5b8-2be2-48d7-80ca-1c113e3e0bc1 req-a5696fa5-aa74-4a0c-a1ae-db1bf9f7f0de service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.259875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-8ad3a5b8-2be2-48d7-80ca-1c113e3e0bc1 req-a5696fa5-aa74-4a0c-a1ae-db1bf9f7f0de service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.273988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-8ad3a5b8-2be2-48d7-80ca-1c113e3e0bc1 req-a5696fa5-aa74-4a0c-a1ae-db1bf9f7f0de service nova] Creating event network-vif-plugged:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:02:20.279911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-8ad3a5b8-2be2-48d7-80ca-1c113e3e0bc1 req-a5696fa5-aa74-4a0c-a1ae-db1bf9f7f0de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040196 Oct 17 18:02:20.281987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 394/772] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:20.372888 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:20.381641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8505c7a1-a93a-4636-af5a-ac4bda33bb61 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.295435 Oct 17 18:02:20.397895 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 379/773] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:20 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:20.535400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:20.536729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:20.541128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-4ed61fcc-836a-47bf-ac74-15fb58dd14e0 req-88520d6d-f91c-4841-aff9-2d977fea6c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906", "tag": "92c42fda-d155-49ee-931b-54fa435e7c51"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:20.557875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.558503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.559107 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.560005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.560572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.561120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.565853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-4ed61fcc-836a-47bf-ac74-15fb58dd14e0 req-88520d6d-f91c-4841-aff9-2d977fea6c69 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.566337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-4ed61fcc-836a-47bf-ac74-15fb58dd14e0 req-88520d6d-f91c-4841-aff9-2d977fea6c69 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.566770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-4ed61fcc-836a-47bf-ac74-15fb58dd14e0 req-88520d6d-f91c-4841-aff9-2d977fea6c69 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.594647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-4ed61fcc-836a-47bf-ac74-15fb58dd14e0 req-88520d6d-f91c-4841-aff9-2d977fea6c69 service nova] Creating event network-changed:92c42fda-d155-49ee-931b-54fa435e7c51 for instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 on hv-cinder-86160 Oct 17 18:02:20.599645 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-4ed61fcc-836a-47bf-ac74-15fb58dd14e0 req-88520d6d-f91c-4841-aff9-2d977fea6c69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062150 Oct 17 18:02:20.600799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 380/774] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:20.683275 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:20.684486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:20.699253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.699789 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.701206 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.702080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:20.704295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:20.705002 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:20.873155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:20.888500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:20.891351 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:20.896299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1627d10b-6272-418b-b0f1-10e07e9c02ce tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.366881 Oct 17 18:02:20.898501 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 395/775] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:20 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:20.978021 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:20.992819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d31ae615-474c-4fee-ab38-3cb6dba0e252 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.317121 Oct 17 18:02:21.007709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 381/776] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:20 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:21.411202 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:21.411926 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:21.418395 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:21.419038 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:21.419734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:21.420702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:21.422195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:21.422894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:21.643650 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:21.652807 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2851344c-1032-48a5-9fad-38206a631db5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.245482 Oct 17 18:02:21.653424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 396/777] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:21 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:21.927480 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:21.928191 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:21.934815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:21.935284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:21.935713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:21.936385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:21.937109 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:21.937474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:22.022364 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:22.023059 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:22.028955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:22.029639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:22.030101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:22.031486 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:22.031976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:22.032424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:22.109946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:22.121896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:22.125431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:22.125431 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8705e1a1-7fe1-4d12-bba2-b776edd2d354 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.201389 Oct 17 18:02:22.156976 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 382/778] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:21 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:22.185982 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:22.194873 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-19f2b86b-20af-4aa0-9f6d-fe1f10f4ee8c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.176788 Oct 17 18:02:22.195544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 397/779] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:22 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:22.680060 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:22.681243 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:22.690807 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:22.691282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:22.691709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:22.692402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:22.692872 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:22.693287 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:22.851908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:22.860270 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-092a69ac-8d4a-45fe-8699-51c5d0d73b21 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.184486 Oct 17 18:02:22.862180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 383/780] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:22 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:23.153937 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:23.154635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:23.161404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:23.161888 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:23.162321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:23.163013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:23.163470 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:23.164048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:23.219301 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:23.221120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:23.240222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:23.241104 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:23.241891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:23.243930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:23.244722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:23.245303 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:23.389898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:23.399389 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:23.401481 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:23.402974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-50b33481-7415-4f50-9695-ec276b9d4110 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.253302 Oct 17 18:02:23.424898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 398/781] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:23 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:23.460015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:23.468776 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-efa0b885-88ff-468d-a1f4-1ef15d2df925 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.252657 Oct 17 18:02:23.469556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 384/782] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:23 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:23.890252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:23.891165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:23.898169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:23.898968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:23.899723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:23.900647 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:23.901221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:23.901802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:24.059373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:24.068074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9026fee4-07bf-442f-b892-ac820fdc5c46 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.182961 Oct 17 18:02:24.068925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 399/783] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:23 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:24.431851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:24.432460 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:24.439894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:24.440783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:24.441418 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:24.442276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:24.442886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:24.443471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:24.494897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:24.496450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:24.517330 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:24.517817 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:24.518243 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:24.518938 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:24.519439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:24.519858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:24.561995 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=4 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:24.681284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:24.692110 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:24.693631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:24.695073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d868ad9f-34f0-4de5-aec5-0854c97ad699 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.267913 Oct 17 18:02:24.695782 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 385/784] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:24 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:24.721541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:24.730086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-03e78525-6b89-43e3-990d-5fd88d7f0257 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.240104 Oct 17 18:02:24.731515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 400/785] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:24 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:25.092457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:25.093564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:25.095775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=8 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:25.101086 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:25.101575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:25.102012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:25.102715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:25.103292 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:25.103803 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:25.245475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:25.253399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-db013d0b-e638-43e6-b9b1-09af300b6bf5 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.165333 Oct 17 18:02:25.253975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 386/786] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:25 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:25.722958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:25.724241 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:25.730588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:25.732266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:25.732266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:25.732266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:25.732699 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:25.733439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:25.765385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:25.766761 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:25.774513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:25.775239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:25.775841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:25.776893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:25.777673 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:25.778264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:25.930120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=14 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:25.950123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:25.964808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:25.966652 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:25.968526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-11c354a2-0a07-4a71-b9cb-242e40cf82b4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.249614 Oct 17 18:02:25.969114 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 401/787] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:25 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:25.993785 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:26.002151 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2030f8f9-fd29-4c0a-8dc7-0a89a3556ab3 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.243048 Oct 17 18:02:26.002731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 387/788] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:25 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:26.279327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:26.280356 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:26.287701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:26.288354 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:26.289018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:26.289864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:26.290456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:26.291040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:26.459911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:26.469898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fcb60995-387f-4358-a8b4-400f92017f43 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.196020 Oct 17 18:02:26.471087 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 402/789] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:26 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:26.996585 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:26.997857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:27.004369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:27.004877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:27.005311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:27.006010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:27.006462 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:27.006889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:27.027977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:27.028505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:27.035440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:27.036312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:27.038714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:27.039712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:27.040390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:27.041091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:27.223146 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:27.234288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:27.236226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:27.237851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2934c878-f434-43bb-8ed6-5ceaa52cdb16 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.245252 Oct 17 18:02:27.246892 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:27.255836 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e3e5788f-21c7-4075-82b1-93082a648415 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.231797 Oct 17 18:02:27.257931 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 388/790] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:26 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:27.265039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 403/791] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:27 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:27.494061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:27.494660 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:27.505232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:27.505713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:27.506376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:27.507277 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:27.508041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:27.508641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:27.657304 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:27.665967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-11215624-57e8-4a05-b3c7-3f2be98a0816 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.176000 Oct 17 18:02:27.666778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 389/792] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:27 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:28.266902 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:28.268042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:28.276541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.278717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.278717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.278717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.278717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.279532 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.285601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:28.286379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:28.295288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.295925 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.297741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.297741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.297962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.298450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.512044 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:28.542703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e26dad0c-03cc-4675-9a35-465a75f77eea tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.264029 Oct 17 18:02:28.543336 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 390/793] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:28 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:28.553473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-4458ff09-5aa1-4293-9176-ece91e09f01b req-aacc8642-97ed-425f-b8f0-0e5465ebb76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906", "name": "network-vif-plugged", "status": "completed", "tag": "92c42fda-d155-49ee-931b-54fa435e7c51"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:28.561982 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:28.565583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:28.574816 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-4458ff09-5aa1-4293-9176-ece91e09f01b req-aacc8642-97ed-425f-b8f0-0e5465ebb76f service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.575032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:28.575302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-4458ff09-5aa1-4293-9176-ece91e09f01b req-aacc8642-97ed-425f-b8f0-0e5465ebb76f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.575798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-4458ff09-5aa1-4293-9176-ece91e09f01b req-aacc8642-97ed-425f-b8f0-0e5465ebb76f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.576515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:28.578074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-928c1e32-27de-4e97-bc20-cc6b0447fcb4 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.316777 Oct 17 18:02:28.580856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 404/794] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:28 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:28.603414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-4458ff09-5aa1-4293-9176-ece91e09f01b req-aacc8642-97ed-425f-b8f0-0e5465ebb76f service nova] Creating event network-vif-plugged:92c42fda-d155-49ee-931b-54fa435e7c51 for instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 on hv-cinder-86160 Oct 17 18:02:28.614376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-4458ff09-5aa1-4293-9176-ece91e09f01b req-aacc8642-97ed-425f-b8f0-0e5465ebb76f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063771 Oct 17 18:02:28.615991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 391/795] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:28.697435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:28.698519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:28.719969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.720724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.721285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.722101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:28.726968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:28.729263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:28.906960 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:28.919491 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9640173c-f14b-4000-ab5c-99fd7fe6364d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.225257 Oct 17 18:02:28.919491 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 405/796] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:28 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:29.572230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:29.572942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:29.579502 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:29.579979 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:29.580410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:29.581120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:29.581571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:29.581995 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:29.607477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:29.612804 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:29.616003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:29.616547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:29.617750 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:29.618641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:29.619149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:29.619651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:29.768286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:29.776874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b457c4ef-eca5-4508-bd3d-7db9a86df5a7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1362 microversion: 2.1 time: 0.209186 Oct 17 18:02:29.777451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 392/797] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:29 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:29.797098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:29.805796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:29.807741 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:29.808947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b3ed391a-9d7f-4058-84cc-80d216089b6f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1740 microversion: 2.20 time: 0.205508 Oct 17 18:02:29.809500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 406/798] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:29 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:29.946434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:29.946967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:29.953554 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:29.954032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:29.954461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:29.955145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:29.955595 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:29.956018 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:30.088293 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:30.097263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bc1fcaf2-e0cc-4a8c-b709-ea7b259db209 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.154782 Oct 17 18:02:30.097868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 393/799] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:29 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:30.637694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-db13c67e-59a7-4079-a80d-1fdd1333d3ea req-aebbf1a4-e9d0-4056-95f7-e452880ff320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949c71e4-fa50-47d6-ac7e-522194d40d7a", "name": "network-vif-plugged", "status": "completed", "tag": "0ad73db8-daee-4a82-827a-4ff8e9c3a0b6"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:30.647631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-db13c67e-59a7-4079-a80d-1fdd1333d3ea req-aebbf1a4-e9d0-4056-95f7-e452880ff320 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:30.648072 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-db13c67e-59a7-4079-a80d-1fdd1333d3ea req-aebbf1a4-e9d0-4056-95f7-e452880ff320 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:30.648489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-db13c67e-59a7-4079-a80d-1fdd1333d3ea req-aebbf1a4-e9d0-4056-95f7-e452880ff320 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:30.659551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-db13c67e-59a7-4079-a80d-1fdd1333d3ea req-aebbf1a4-e9d0-4056-95f7-e452880ff320 service nova] Creating event network-vif-plugged:0ad73db8-daee-4a82-827a-4ff8e9c3a0b6 for instance 949c71e4-fa50-47d6-ac7e-522194d40d7a on hv-cinder-86160 Oct 17 18:02:30.664214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-db13c67e-59a7-4079-a80d-1fdd1333d3ea req-aebbf1a4-e9d0-4056-95f7-e452880ff320 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030216 Oct 17 18:02:30.664827 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 407/800] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:30.801415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:30.802048 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:30.808655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:30.809128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:30.809553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:30.810230 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:30.810680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:30.811098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:30.816250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:30.835392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:30.836076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:30.842238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:30.842718 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:30.843149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:30.843837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:30.844287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:30.844732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:31.006472 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:31.014197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f9313e6d-7872-4460-98e5-350119371b66 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1548 microversion: 2.1 time: 0.218010 Oct 17 18:02:31.014700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 394/801] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:30 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:31.037343 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:31.037832 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:31.043622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:31.044103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:31.044541 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:31.045257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:31.045709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:31.046134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:31.058266 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:31.067537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:31.069237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:31.070466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f66612e6-18fc-454f-9667-71e9b3e213bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1722 microversion: 2.20 time: 0.239366 Oct 17 18:02:31.071140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 408/802] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:30 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:31.121117 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:31.121715 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:31.127370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f428077c-9cb2-4e52-8cd4-ba64e7433d34 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093771 Oct 17 18:02:31.129704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:31.129928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:31.141080 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:31.141219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 395/803] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 18:02:31 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:31.141327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:31.141327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:31.141327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:31.346273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:31.354666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-88bcf4a8-d0f4-4eb7-8995-16070896b61d tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.237673 Oct 17 18:02:31.355145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 409/804] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:31 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:02:32.097580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:32.098196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:32.104405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:32.104923 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:32.105362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:32.106063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:32.106515 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:32.106944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:32.192544 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-6d3d7fd9-e719-4c48-b4a5-88091dae2bbb req-a6d43cfb-4486-455f-9712-310a6c022980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906", "tag": "92c42fda-d155-49ee-931b-54fa435e7c51"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:32.201944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-6d3d7fd9-e719-4c48-b4a5-88091dae2bbb req-a6d43cfb-4486-455f-9712-310a6c022980 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:32.202417 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-6d3d7fd9-e719-4c48-b4a5-88091dae2bbb req-a6d43cfb-4486-455f-9712-310a6c022980 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:32.203505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-6d3d7fd9-e719-4c48-b4a5-88091dae2bbb req-a6d43cfb-4486-455f-9712-310a6c022980 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:32.215551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-6d3d7fd9-e719-4c48-b4a5-88091dae2bbb req-a6d43cfb-4486-455f-9712-310a6c022980 service nova] Creating event network-changed:92c42fda-d155-49ee-931b-54fa435e7c51 for instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 on hv-cinder-86160 Oct 17 18:02:32.221600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-6d3d7fd9-e719-4c48-b4a5-88091dae2bbb req-a6d43cfb-4486-455f-9712-310a6c022980 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097682 Oct 17 18:02:32.222538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 410/805] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:32.258805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:32.267387 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:32.268864 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:32.270020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-405612fa-02be-4efc-87da-bd6b995b4210 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1722 microversion: 2.20 time: 0.176929 Oct 17 18:02:32.270595 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 396/806] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:32 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:32.379047 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:32.379743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:32.385820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:32.386300 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:32.386734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:32.387425 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:32.387871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:32.388295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:32.524553 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:32.532583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d4181b12-cfd9-4fdb-a5bc-1715cf666840 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.158179 Oct 17 18:02:32.533200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 411/807] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:32 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:33.298150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:33.298791 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:33.301183 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:33.306192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:33.306630 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:33.307064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:33.307750 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:33.308199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:33.308649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:33.446128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:33.457264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:33.457264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:33.457264 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ab510d83-266d-443b-9c95-5cbc00ae1c3d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1722 microversion: 2.20 time: 0.163531 Oct 17 18:02:33.457725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 397/808] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:33 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:33.555183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:33.555815 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:33.562645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:33.563122 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:33.563554 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:33.564237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:33.564713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:33.565136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:33.698342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:33.706393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-947b0340-1d81-484c-ac08-9bddd460a784 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1266 microversion: 2.1 time: 0.155090 Oct 17 18:02:33.706954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 412/809] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:33 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:34.275665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-f442489a-c3e2-4d54-b546-6738174d3263 req-a631e400-71bf-42c8-888d-d2c6d32f631e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "name": "network-vif-unplugged", "status": "completed", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:34.285647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f442489a-c3e2-4d54-b546-6738174d3263 req-a631e400-71bf-42c8-888d-d2c6d32f631e service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.286119 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f442489a-c3e2-4d54-b546-6738174d3263 req-a631e400-71bf-42c8-888d-d2c6d32f631e service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.286540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f442489a-c3e2-4d54-b546-6738174d3263 req-a631e400-71bf-42c8-888d-d2c6d32f631e service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:34.297402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-f442489a-c3e2-4d54-b546-6738174d3263 req-a631e400-71bf-42c8-888d-d2c6d32f631e service nova] Creating event network-vif-unplugged:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:02:34.302728 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-f442489a-c3e2-4d54-b546-6738174d3263 req-a631e400-71bf-42c8-888d-d2c6d32f631e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030751 Oct 17 18:02:34.303430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 398/810] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:34.483897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:34.484439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:34.491092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.491567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.494216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:34.494216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.494216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.494216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:34.693952 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:34.702307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:34.703982 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:34.705190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-592efe3d-b714-42cc-a535-7f389db32245 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1722 microversion: 2.20 time: 0.225880 Oct 17 18:02:34.705836 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 413/811] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:34 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:34.730438 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:34.731288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:34.738801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.739219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.739659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:34.740448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.740941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.741503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:34.910757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:34.918677 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fa04c484-4e8b-4184-bf72-c09a4babf826 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1453 microversion: 2.1 time: 0.192699 Oct 17 18:02:34.919245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 399/812] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:34 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:34.942589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:34.944508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:34.949111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.949645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.950082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:34.950768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:34.951224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:34.951647 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:35.429904 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:35.437828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ba9d9f0b-3355-4d96-86e2-b473eaa0f022 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1453 microversion: 2.1 time: 0.499153 Oct 17 18:02:35.438630 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 414/813] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:02:34 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1453 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:02:35.732138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:35.732717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:35.740236 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:35.740763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:35.741194 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:35.741890 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:35.742336 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:35.742754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:35.883963 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:35.892796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:35.895009 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:35.896179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f51ee98a-588f-4dcd-a5a0-410562411688 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1665 microversion: 2.20 time: 0.168158 Oct 17 18:02:35.896771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 400/814] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:35 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:35.922089 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a0a6d2a-4d33-4bcb-9247-b4c6a8b1090d"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:35.927829 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:35.932406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:35.932921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:35.933362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:35.934144 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:35.934574 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:35.934994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:36.819922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-68bd4a51-2fd2-48be-9531-f5a0fe8a2d0e tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.901870 Oct 17 18:02:36.820556 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 415/815] 10.222.0.58 () {62 vars in 1364 bytes} [Mon Oct 17 18:02:35 2022] POST /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-volume_attachments => generated 188 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 18:02:36.953843 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:36.954357 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:36.961546 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:36.962536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:36.962536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:36.963115 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:36.963565 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:36.963988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:37.562810 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2f724987-ebe3-4799-93b3-88e21ed5c164 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-volume_attachments/4a0a6d2a-4d33-4bcb-9247-b4c6a8b1090d" status: 202 len: 0 microversion: 2.20 time: 0.612839 Oct 17 18:02:37.573075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 401/816] 10.222.0.58 () {60 vars in 1457 bytes} [Mon Oct 17 18:02:36 2022] DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-volume_attachments/4a0a6d2a-4d33-4bcb-9247-b4c6a8b1090d => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:02:37.575112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-f599a266-66f9-4d45-b81d-41d06eb51f2e req-03cc62b0-9f56-4259-80d6-fa965cc35c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949c71e4-fa50-47d6-ac7e-522194d40d7a", "tag": "0ad73db8-daee-4a82-827a-4ff8e9c3a0b6"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:37.587013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f599a266-66f9-4d45-b81d-41d06eb51f2e req-03cc62b0-9f56-4259-80d6-fa965cc35c9c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:37.587581 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f599a266-66f9-4d45-b81d-41d06eb51f2e req-03cc62b0-9f56-4259-80d6-fa965cc35c9c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:37.588079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f599a266-66f9-4d45-b81d-41d06eb51f2e req-03cc62b0-9f56-4259-80d6-fa965cc35c9c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:37.599629 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-f599a266-66f9-4d45-b81d-41d06eb51f2e req-03cc62b0-9f56-4259-80d6-fa965cc35c9c service nova] Creating event network-changed:0ad73db8-daee-4a82-827a-4ff8e9c3a0b6 for instance 949c71e4-fa50-47d6-ac7e-522194d40d7a on hv-cinder-86160 Oct 17 18:02:37.605521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-f599a266-66f9-4d45-b81d-41d06eb51f2e req-03cc62b0-9f56-4259-80d6-fa965cc35c9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034365 Oct 17 18:02:37.606310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 416/817] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:37.634519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:37.635113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:37.641188 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:37.641703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:37.642228 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:37.642957 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:37.644045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:37.644045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:37.697844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126522) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 18:02:38.115836 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-af34820a-1ca1-4158-acef-1d368153865f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "POST /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/action" status: 202 len: 0 microversion: 2.20 time: 0.485965 Oct 17 18:02:38.121215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 402/818] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 17 18:02:37 2022] POST /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:02:38.127025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:38.127460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:38.133838 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:38.134622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:38.135258 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:38.136198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:38.136759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:38.137393 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:38.320564 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:38.339280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:38.340765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:38.346446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-189eb571-46f1-4825-8d7a-f669870d6b5f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1673 microversion: 2.20 time: 0.219966 Oct 17 18:02:38.346446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 417/819] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:38 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:39.371726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:39.372325 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:39.379521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:39.383581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:39.383581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:39.383581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:39.383581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:39.384040 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:39.512053 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:39.521861 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:39.523378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:39.525033 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-022b4bc4-80b2-4da1-abef-7c1ee2661d29 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1673 microversion: 2.20 time: 0.157674 Oct 17 18:02:39.525902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 403/820] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:39 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:40.552221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:40.553903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:40.559600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:40.560073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:40.560501 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:40.561293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:40.561732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:40.562147 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:40.776035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:40.784893 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:40.786348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:40.787501 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d2127732-b6c4-40a7-ad49-92ddcd04427c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.240397 Oct 17 18:02:40.788071 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 418/821] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:40 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:41.813171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:41.813726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:41.821092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:41.821584 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:41.822022 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:41.822722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:41.823182 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:41.823614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:41.984255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:41.992853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:41.994312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:41.995479 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b220215d-ff15-41be-a071-c7c372ae7b08 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.186293 Oct 17 18:02:41.996219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 404/822] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:41 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:42.581964 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:42.582504 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:42.584949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:42.590006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:42.590488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:42.590918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:42.591614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:42.592063 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:42.592482 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:42.617631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9146d17b-c1d9-4285-9d32-66aac61c94a7 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039659 Oct 17 18:02:42.618387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 419/823] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 18:02:42 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:43.021893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:43.023056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:43.030282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:43.034154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:43.034154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:43.034154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:43.034154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:43.034700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:43.202454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:43.211362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:43.212948 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:43.214107 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-421c2af2-1574-4b75-9c92-2045082cb32b tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.196819 Oct 17 18:02:43.215762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 405/824] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:43 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:44.245164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:44.246446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:44.254335 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:44.254891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:44.255508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:44.256411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:44.257047 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:44.261490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:44.286752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3040e6ac-6f6b-4d51-bbe8-ba34a69c717b"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:44.289203 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:44.295447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:44.296160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:44.296458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:44.297187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:44.297642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:44.298068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:44.398456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:44.407327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:44.409299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:44.410886 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-aec18fd2-a062-4dce-9a2f-228062505843 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.173844 Oct 17 18:02:44.411979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 420/825] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:44 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:45.437947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:45.438667 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:45.447757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:45.448368 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:45.448900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:45.449878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:45.450403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:45.450903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:45.455983 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:45.586992 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:45.595008 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:45.596431 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:45.598119 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2c61c061-90ec-4ec1-98c7-3e93782e718c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.163599 Oct 17 18:02:45.598687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 421/826] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:45 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:46.623338 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:46.624031 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:46.631098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:46.631579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:46.632009 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:46.632732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:46.633185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:46.633606 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:46.778110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:46.784328 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:46.786542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:46.787688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-20b79c29-b238-4530-98a5-688ba9719118 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.168274 Oct 17 18:02:46.788255 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 422/827] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:46 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:47.814559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:47.815212 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:47.822379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:47.822856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:47.823366 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:47.824062 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:47.824507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:47.824955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:47.976835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:47.985141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:47.986716 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:47.987871 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d98d277e-e0d0-41b4-af2d-7e9864ff6d90 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.177460 Oct 17 18:02:47.989096 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 423/828] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:47 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:49.014714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:49.020227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:49.022297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:49.022768 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:49.023193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:49.023864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:49.024305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:49.024744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:49.171450 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:49.180048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:49.181748 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:49.182872 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-884e15e8-a490-4179-bbfc-b9b90b57a36f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.172129 Oct 17 18:02:49.183428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 424/829] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:49 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:50.213432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:50.213432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:50.218212 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:50.218704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:50.219146 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:50.219841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:50.220288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:50.220730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:50.369096 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:50.377811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:50.379306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:50.380728 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1ffca707-a72b-4e40-99fc-8c569a84fc40 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.174995 Oct 17 18:02:50.389161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 425/830] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:50 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:51.406763 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:51.407596 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:51.413744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:51.414796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:51.415236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:51.415919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:51.416364 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:51.416811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:51.552754 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:51.559745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:51.561220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:51.562364 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-177e8774-6b3c-467f-ba15-e702b49e153d tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.159471 Oct 17 18:02:51.562924 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 426/831] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:51 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:52.592683 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:52.600133 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:52.600306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:52.600821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:52.601256 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:52.601942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:52.602390 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:52.602809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:52.730407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:52.738341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:52.740506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:52.741703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-35e5f1bf-8510-4fbe-aeeb-f1f354c1f7b6 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.152894 Oct 17 18:02:52.742265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 427/832] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:52 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 18:02:52.766955 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-efdbe29a-77b4-48a0-ad36-9aac62cdb830 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "POST /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.484626 Oct 17 18:02:52.767550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 406/833] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:02:44 2022] POST /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments => generated 194 bytes in 8486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:02:53.767155 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:53.767757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:53.774375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:53.774855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:53.775288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:53.775974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:53.776538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:53.777776 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:53.908957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:53.918215 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:53.919665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:53.920921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-25c1c0ec-23a7-4022-b48c-859f7a9a20c5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.157695 Oct 17 18:02:53.921489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 428/834] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:53 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:54.955942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:54.959045 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:54.959627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:54.964586 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:54.965094 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:54.965525 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:54.966254 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:54.966709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:54.967130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:54.972313 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:02:55.102930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:55.110940 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:55.112405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:55.113623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-72536858-4024-489a-b567-aca38f001fba tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.162030 Oct 17 18:02:55.114193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 407/835] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:54 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:56.139506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:56.140061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:56.146855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:56.147327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:56.147758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:56.148435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:56.148918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:56.149339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:56.276261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:56.284301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:56.285757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:56.287125 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-13ccabbb-fc4a-48bd-8f89-a18dca321484 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.151677 Oct 17 18:02:56.287680 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 429/836] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:56 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:56.462129 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-6e081719-0655-40a8-a860-1e46f5606906 req-cd62dc38-df1f-4f96-ab5e-1f3ac8f9a664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "name": "network-vif-plugged", "status": "completed", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:02:56.471719 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-6e081719-0655-40a8-a860-1e46f5606906 req-cd62dc38-df1f-4f96-ab5e-1f3ac8f9a664 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:56.472199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-6e081719-0655-40a8-a860-1e46f5606906 req-cd62dc38-df1f-4f96-ab5e-1f3ac8f9a664 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:56.472686 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-6e081719-0655-40a8-a860-1e46f5606906 req-cd62dc38-df1f-4f96-ab5e-1f3ac8f9a664 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:56.483473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-6e081719-0655-40a8-a860-1e46f5606906 req-cd62dc38-df1f-4f96-ab5e-1f3ac8f9a664 service nova] Creating event network-vif-plugged:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:02:56.488217 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-6e081719-0655-40a8-a860-1e46f5606906 req-cd62dc38-df1f-4f96-ab5e-1f3ac8f9a664 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029799 Oct 17 18:02:56.489028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 408/837] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:02:57.312663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:57.313264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:57.320480 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:57.320979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:57.321411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:57.322097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:57.322548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:57.322968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:57.450519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:57.458630 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:57.459968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:57.461145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b0a063fc-b5a6-4fb0-8b19-269abde1849f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.152439 Oct 17 18:02:57.461703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 430/838] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:57 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:58.487716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:58.488395 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:58.495961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:58.500828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:58.500828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:58.500828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:58.500828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:58.501224 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:58.632539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:58.640719 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:58.642162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:58.643330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-68f932be-8de1-4f53-ba04-833c9b05e89f tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1731 microversion: 2.20 time: 0.160487 Oct 17 18:02:58.643879 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 409/839] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:58 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:02:59.669726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:02:59.670358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:02:59.676771 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:59.677766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:59.678190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:59.678867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:02:59.679317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:02:59.679736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:02:59.810281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:59.819852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:59.821406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:02:59.822546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0549c03c-33aa-406d-90c9-3d4fa817a2d5 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1718 microversion: 2.20 time: 0.156749 Oct 17 18:02:59.828066 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 431/840] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:02:59 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:03:00.419977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:00.420498 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:00.426738 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:00.427215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:00.428164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:00.428868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:00.429318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:00.429738 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:00.509834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'services' on Instance uuid 93a4ff70-3471-4260-b4d4-528b64caf25e {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:03:00.704218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-411357f9-9094-43f2-96a6-d86a5a4818dd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments/3040e6ac-6f6b-4d51-bbe8-ba34a69c717b" status: 202 len: 0 microversion: 2.1 time: 0.287903 Oct 17 18:03:00.704844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 410/841] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:03:00 2022] DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments/3040e6ac-6f6b-4d51-bbe8-ba34a69c717b => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:03:00.713847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:00.716179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:00.722683 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:00.723164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:00.723601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:00.724322 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:00.724936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:00.725231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:00.754000 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1f1349a4-0446-4371-b373-7040adea3701 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Oct 17 18:03:00.754555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 432/842] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:03:00 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:03:01.768841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:01.771226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:01.777707 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:01.778195 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:01.778632 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:01.779328 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:01.779800 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:01.780211 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:01.813252 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-22e60423-8693-468a-9612-b86c8028bf55 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049923 Oct 17 18:03:01.813817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 411/843] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:03:01 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:03:02.826099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:02.828353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:02.834823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:02.835295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:02.835718 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:02.836394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:02.836865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:02.838106 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:02.872694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5c3c55b1-25fb-41bb-8821-46fc42caad4f tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050450 Oct 17 18:03:02.873278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 433/844] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:03:02 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:03:02.936611 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:02.937180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:02.943108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:02.946441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:02.946441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:02.946441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:02.946441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:02.946844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:02.971056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:03:03.157084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e3e53287-08d7-4126-9e01-e6e9d50f6842 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 204 len: 0 microversion: 2.1 time: 0.223908 Oct 17 18:03:03.157600 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 412/845] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:03:02 2022] DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:03:03.167092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:03.167688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:03.173615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:03.174095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:03.174556 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:03.175310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:03.175756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:03.176170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:03.302915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:03.311340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cb94eaec-d99c-469a-916a-58839abf1d38 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1680 microversion: 2.1 time: 0.149417 Oct 17 18:03:03.311903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 434/846] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:03 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:04.336082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:04.336833 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:04.343171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:04.343683 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:04.344120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:04.344828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:04.345284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:04.345715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:04.477038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:04.484836 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5682be31-39b4-4d0a-9391-3b6336db37bf tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1680 microversion: 2.1 time: 0.153214 Oct 17 18:03:04.485417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 413/847] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:04 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:05.508997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:05.509517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:05.515939 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:05.516418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:05.516876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:05.517562 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:05.518012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:05.518431 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:05.611418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:05.619589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-bdd6c2ae-f3dc-4b0f-9ff7-bf3d960c0412 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1613 microversion: 2.1 time: 0.115494 Oct 17 18:03:05.620167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 435/848] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:05 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:05.875367 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-85e9650c-a062-4f7c-855c-9b39ee6506c5 req-738b01a4-866f-492d-ac19-03c3b2163dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4ff70-3471-4260-b4d4-528b64caf25e", "name": "network-vif-deleted", "tag": "39ad0571-44f9-4cd9-950c-cae84df52bb7"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:05.887419 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-85e9650c-a062-4f7c-855c-9b39ee6506c5 req-738b01a4-866f-492d-ac19-03c3b2163dff service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:05.888250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-85e9650c-a062-4f7c-855c-9b39ee6506c5 req-738b01a4-866f-492d-ac19-03c3b2163dff service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:05.892040 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-85e9650c-a062-4f7c-855c-9b39ee6506c5 req-738b01a4-866f-492d-ac19-03c3b2163dff service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:05.900938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-85e9650c-a062-4f7c-855c-9b39ee6506c5 req-738b01a4-866f-492d-ac19-03c3b2163dff service nova] Creating event network-vif-deleted:39ad0571-44f9-4cd9-950c-cae84df52bb7 for instance 93a4ff70-3471-4260-b4d4-528b64caf25e on hv-cinder-86160 Oct 17 18:03:05.905835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-85e9650c-a062-4f7c-855c-9b39ee6506c5 req-738b01a4-866f-492d-ac19-03c3b2163dff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040312 Oct 17 18:03:05.906607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 414/849] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:03:06.643365 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:06.643981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:06.650513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:06.650987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:06.651416 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:06.653340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:06.653340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:06.653813 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:06.686976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:06.687438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:06.687957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:06.688370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lazy-loading 'fault' on Instance uuid 93a4ff70-3471-4260-b4d4-528b64caf25e {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:03:06.732465 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3c14157b684187bb00f5a42be62fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b0aca8f07d4eae89d9b8ed8abea1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:06.740231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e87f4f53-8148-47cc-be19-65ba462aaf28 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 200 len: 1330 microversion: 2.1 time: 0.100810 Oct 17 18:03:06.741261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 436/850] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:06 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:07.770506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:07.771192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:07.778189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:07.778668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:07.779092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:07.779762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:07.780207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:07.780646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:07.794616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e HTTP/1.1 Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:07.796242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:07.798103 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '93a4ff70-3471-4260-b4d4-528b64caf25e'} Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:07.799038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:07.800569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:07.801982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:07.801982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7df2d101-8131-4984-9f2a-b2ca874c7596 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 404 len: 111 microversion: 2.1 time: 0.031893 Oct 17 18:03:07.801982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 415/851] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:07 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:07.806881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-52368aeb-de71-44bc-8b62-f32ba0389097 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '.version_select at 0x7f01961a28b0>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:07.889487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-52368aeb-de71-44bc-8b62-f32ba0389097 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608074087" status: 202 len: 0 microversion: 2.1 time: 0.086667 Oct 17 18:03:07.893281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 437/852] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608074087 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:03:09.799792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:09.800314 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:09.807492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:09.807965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:09.808396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:09.809122 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:09.809565 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:09.809987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:09.823755 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e HTTP/1.1 Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:09.825309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.826953 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '93a4ff70-3471-4260-b4d4-528b64caf25e'} Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:09.827743 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.828969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.830354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:09.830354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-50a7a79d-1a62-4e7b-a7f3-55780bd49f52 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 404 len: 111 microversion: 2.1 time: 0.030728 Oct 17 18:03:09.830354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 416/853] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:03:09 2022] DELETE /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:09.835713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:09.836327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 93a4ff70-3471-4260-b4d4-528b64caf25e] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:09.842881 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:09.843367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:09.843805 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:09.844490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:09.844971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:09.845392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:09.858462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e HTTP/1.1 Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:09.860245 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.863101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '93a4ff70-3471-4260-b4d4-528b64caf25e'} Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:09.864018 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. Oct 17 18:03:09.866053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:09.867460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance 93a4ff70-3471-4260-b4d4-528b64caf25e could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:09.867460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2c003f23-9d26-4f69-af2a-27fd4b65dd33 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e" status: 404 len: 111 microversion: 2.1 time: 0.030528 Oct 17 18:03:09.867460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 438/854] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:09 2022] GET /compute/v2.1/servers/93a4ff70-3471-4260-b4d4-528b64caf25e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:11.120931 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:11.122003 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:11.128295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.128799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.129236 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.129916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.130372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.130792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.144218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 HTTP/1.1 Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:11.145684 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.147251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'b9579f87-21e4-4c60-9ac5-3202aff271d7'} Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:11.148074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.150124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.151576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:11.151576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d25fa87e-9f95-415e-9b22-aefb210ae450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 404 len: 111 microversion: 2.1 time: 0.031403 Oct 17 18:03:11.151576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 417/855] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:03:11 2022] DELETE /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:11.155726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:11.156406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: b9579f87-21e4-4c60-9ac5-3202aff271d7] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:11.162858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.163334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.163766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.164439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.165746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.166142 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.170031 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=100 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:03:11.182339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 HTTP/1.1 Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:11.183934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.185626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'b9579f87-21e4-4c60-9ac5-3202aff271d7'} Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:11.186462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. Oct 17 18:03:11.187925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.189207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance b9579f87-21e4-4c60-9ac5-3202aff271d7 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:11.189207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-abc1cdf8-b692-4477-ab28-e28b92d69cbd tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7" status: 404 len: 111 microversion: 2.1 time: 0.033487 Oct 17 18:03:11.189207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 439/856] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:11 2022] GET /compute/v2.1/servers/b9579f87-21e4-4c60-9ac5-3202aff271d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:11.193873 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:11.194364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:11.200403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.200916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.201349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.202026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.202474 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.202893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.215909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd HTTP/1.1 Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:11.217425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.219089 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '675604a3-eb66-477f-ac4b-e12b1fbbdedd'} Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:11.219988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.221508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.223242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:11.223242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d9d75757-9d0f-4cd1-8834-ce25c62a1450 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 404 len: 111 microversion: 2.1 time: 0.028806 Oct 17 18:03:11.223242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 418/857] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:03:11 2022] DELETE /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:11.227645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:11.228360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: 675604a3-eb66-477f-ac4b-e12b1fbbdedd] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:11.234819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.235283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.235707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.236376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:11.236844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:11.237261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:11.251818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd HTTP/1.1 Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:11.253343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.254934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '675604a3-eb66-477f-ac4b-e12b1fbbdedd'} Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:11.255847 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. Oct 17 18:03:11.257340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:11.258849 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance 675604a3-eb66-477f-ac4b-e12b1fbbdedd could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:11.258849 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-921c2386-9c64-4b2c-88ea-1656d26ca9dc tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd" status: 404 len: 111 microversion: 2.1 time: 0.031408 Oct 17 18:03:11.258849 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 440/858] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:11 2022] GET /compute/v2.1/servers/675604a3-eb66-477f-ac4b-e12b1fbbdedd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:12.476655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:12.477152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:12.484057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:12.484537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:12.485003 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:12.485687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:12.486137 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:12.486558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:12.500207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 HTTP/1.1 Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:12.501762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.503330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'bf4103da-d0cb-4d9c-b475-e0ee08b57398'} Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:12.504155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.505451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.506652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:12.506652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f5eab47b-8185-4088-bc4f-4452a0456ee8 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 404 len: 111 microversion: 2.1 time: 0.030338 Oct 17 18:03:12.506652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 419/859] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:03:12 2022] DELETE /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:12.511559 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:12.512164 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] [instance: bf4103da-d0cb-4d9c-b475-e0ee08b57398] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:12.518524 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:12.519007 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:12.519436 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:12.520116 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:12.520564 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:12.521034 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:12.534343 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] HTTP exception thrown: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Request method failure captured: Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 HTTP/1.1 Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdFdQQRUC4i2hptAUkt_4UdOyZeu2thAyfy0581Mr5iVHoKblpZeKk7daePf5fSKT7Dm-wRbVAadX7fGjdyVLsHS68HO2brJq3UJrxvacxbs8g4eXsBxtgzTJ_frrEfY7xgIOMBbqjknbTXdYAGJdOtpzOA7FexhFX35UDsX85Cuw8 Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:12.535858 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f7b0aca8f07d4eae89d9b8ed8abea1bf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f7b0aca8f07d4eae89d9b8ed8abea1bf"}]}] Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: f7b0aca8f07d4eae89d9b8ed8abea1bf Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117617032 Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: db3c14157b684187bb00f5a42be62fed Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeNegativeTest-2117617032-project Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.537321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'bf4103da-d0cb-4d9c-b475-e0ee08b57398'} Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:12.538042 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. Oct 17 18:03:12.539204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:12.541280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] Returning 404 to user: Instance bf4103da-d0cb-4d9c-b475-e0ee08b57398 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:12.541280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-172ab275-cb3b-4a47-a9cc-af0c2d9be7a6 tempest-AttachVolumeNegativeTest-2117617032 tempest-AttachVolumeNegativeTest-2117617032-project] 10.222.0.58 "GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398" status: 404 len: 111 microversion: 2.1 time: 0.029685 Oct 17 18:03:12.541280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 441/860] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:12 2022] GET /compute/v2.1/servers/bf4103da-d0cb-4d9c-b475-e0ee08b57398 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:16.755081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:16.755614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:16.762450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:16.762928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:16.763363 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:16.764057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:16.764491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:16.764939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:16.790562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-787426aa-5e55-45f6-a905-39b20266c62f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/ips" status: 200 len: 146 microversion: 2.1 time: 0.038815 Oct 17 18:03:16.791108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 420/861] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 18:03:16 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:03:19.292120 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da420f9a-df3e-42e7-9948-2fa387d6e6a6"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:19.294460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:19.297030 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:03:19.301915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:19.302598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:19.302963 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:19.303726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:19.304169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:19.304610 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:19.989896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d3cbcb0a-1cb3-4bbf-8968-6c10cc4f02f7 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701610 Oct 17 18:03:19.990511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 442/862] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:03:19 2022] POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:03:27.553947 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6ef1f4e3-6eaa-4329-9d33-ab640dc1bd89 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:27.556866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:03:27.557513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:03:27.563331 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6ef1f4e3-6eaa-4329-9d33-ab640dc1bd89 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:27.563811 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6ef1f4e3-6eaa-4329-9d33-ab640dc1bd89 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:27.564237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6ef1f4e3-6eaa-4329-9d33-ab640dc1bd89 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:27.627687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6ef1f4e3-6eaa-4329-9d33-ab640dc1bd89 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Going to try to stop instance {{(pid=126522) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 18:03:27.836204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6ef1f4e3-6eaa-4329-9d33-ab640dc1bd89 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action" status: 202 len: 0 microversion: 2.1 time: 0.285979 Oct 17 18:03:27.836841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 421/863] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:03:27 2022] POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:03:27.847673 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:27.848431 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:27.854807 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:27.855285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:27.855713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:27.856428 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:27.856936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:27.864954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:28.005148 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:28.013792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2b27a238-2a8f-4515-b351-d512e7298047 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.171632 Oct 17 18:03:28.014736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 443/864] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:27 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:03:29.039820 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:29.041175 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:29.050015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:29.050503 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:29.050941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:29.051641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:29.052097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:29.052523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:29.207668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:29.215908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-42928611-84ae-4b56-a2fb-db5d0517b321 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.181487 Oct 17 18:03:29.216513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 422/865] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:29 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:30.241670 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:30.242400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:30.249464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:30.250118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:30.250604 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:30.251067 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:30.251521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:30.251942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:30.381976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:30.390195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fd0d31e3-1607-490f-aaa4-8d772a6f5b2d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.152309 Oct 17 18:03:30.390765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 444/866] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:30 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:31.413476 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:31.414121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:31.422714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:31.423188 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:31.423616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:31.424300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:31.424776 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:31.425198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:31.555054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:31.564504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-095eb339-28e9-4db8-91ce-46ecee064b0f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.155029 Oct 17 18:03:31.565100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 423/867] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:31 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:32.587723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:32.588329 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:32.594777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:32.595254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:32.595689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:32.596375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:32.596852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:32.597273 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:32.729102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:32.737799 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a3e0f9d2-2d5b-46c8-bc8a-7816b7849061 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.153975 Oct 17 18:03:32.738361 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 445/868] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:32 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:33.032409 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:33.034949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:33.041414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.041893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.042329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.043054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.043510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.043940 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.075156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-40e766b5-ae3f-46ce-94e6-e3080a0e3e20 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047403 Oct 17 18:03:33.075731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 424/869] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 17 18:03:33 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:33.144537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:33.145057 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:33.150852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.151317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.151737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.152407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.152878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.153290 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.177978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:03:33.459505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-790d27d4-56a6-4013-b8a9-9926f3a920d2 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 204 len: 0 microversion: 2.20 time: 0.319063 Oct 17 18:03:33.460285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 446/870] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 17 18:03:33 2022] DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 18:03:33.468386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:33.469013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:33.475279 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.475746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.476174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.476877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.477326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.477747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.609341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:33.617946 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:33.619381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:33.620528 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b606ea0d-efa4-47b9-ab94-4667710e312a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.155988 Oct 17 18:03:33.621113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 425/871] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:33 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:03:33.762713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:33.763435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:33.770378 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.770856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.771292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.772050 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:33.772502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:33.772950 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:33.912434 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:33.920703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cc57403f-0255-481a-b309-110fbbf03b32 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.162499 Oct 17 18:03:33.921272 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 447/872] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:33 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:34.646607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:34.647130 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:34.653550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:34.655318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:34.655318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:34.655318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:34.655594 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:34.655998 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:34.786674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:34.794732 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:34.796158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:34.797329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4b5d1312-dca2-46c8-b433-ba583dc1e97a tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.154726 Oct 17 18:03:34.797885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 426/873] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:34 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:03:34.944445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:34.945075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:34.951686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:34.952223 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:34.952740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:34.953477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:34.953968 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:34.954395 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:35.450555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:35.459324 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-59cf2460-c425-4ac4-bea5-7d2dce9c8b75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.519890 Oct 17 18:03:35.459916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 448/874] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:34 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:35.826176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:35.827284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:35.834512 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:35.835281 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:35.835691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:35.836396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:35.836848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:35.837265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:36.047067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:36.055360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:36.057166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:36.058330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-53554c78-bcdb-40e2-a5f6-9d30549fd364 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1724 microversion: 2.20 time: 0.237220 Oct 17 18:03:36.058903 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 427/875] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:35 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:03:36.276012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-285daf3d-d411-46c7-9aae-8aa68c9db3d3 req-77ee6d83-9e12-4507-9c6b-5d35ed4dc0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907637d1-192e-4a1a-8925-86218c9015a5", "name": "network-vif-deleted", "tag": "29146837-12ad-4fe6-a1a3-1405c26333de"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:36.287616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-285daf3d-d411-46c7-9aae-8aa68c9db3d3 req-77ee6d83-9e12-4507-9c6b-5d35ed4dc0a4 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:36.288102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-285daf3d-d411-46c7-9aae-8aa68c9db3d3 req-77ee6d83-9e12-4507-9c6b-5d35ed4dc0a4 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:36.306112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-285daf3d-d411-46c7-9aae-8aa68c9db3d3 req-77ee6d83-9e12-4507-9c6b-5d35ed4dc0a4 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:36.325236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-285daf3d-d411-46c7-9aae-8aa68c9db3d3 req-77ee6d83-9e12-4507-9c6b-5d35ed4dc0a4 service nova] Creating event network-vif-deleted:29146837-12ad-4fe6-a1a3-1405c26333de for instance 907637d1-192e-4a1a-8925-86218c9015a5 on hv-cinder-86160 Oct 17 18:03:36.330402 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-285daf3d-d411-46c7-9aae-8aa68c9db3d3 req-77ee6d83-9e12-4507-9c6b-5d35ed4dc0a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058203 Oct 17 18:03:36.331500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 449/876] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:03:36.483353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:36.483757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:36.492177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:36.492729 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:36.495624 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:36.495624 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:36.495624 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:36.495624 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:36.635054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:36.643519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a1b7eb12-3518-4800-8cd0-5ea0264be893 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.164340 Oct 17 18:03:36.654961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 428/877] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:36 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:37.086505 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:37.087317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:37.094909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:37.095392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:37.095821 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:37.096514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:37.097013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:37.098012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:37.131944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:37.132352 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:37.132806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:37.133281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lazy-loading 'fault' on Instance uuid 907637d1-192e-4a1a-8925-86218c9015a5 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:03:37.179277 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:37.188075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:37.189593 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a5d88c557c45b38724e8dafc0d0296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8272c0b90914361ae6f6c3a062380df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:37.190745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a0ce466c-d331-43b7-acbd-75e2b3f6a04c tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 200 len: 1371 microversion: 2.20 time: 0.110016 Oct 17 18:03:37.191536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 450/878] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:37 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 18:03:37.668077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:37.668712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:37.675197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:37.675771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:37.683080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:37.683080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:37.683080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:37.683080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:37.813192 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:37.822454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a5fe47fc-3aeb-42f3-b574-9262f0844d5c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.158188 Oct 17 18:03:37.823451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 429/879] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:37 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:38.217841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:38.219044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:38.225654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:38.226123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:38.226546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:38.227217 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:38.227659 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:38.228075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:38.241609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] HTTP exception thrown: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Request method failure captured: Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 HTTP/1.1 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdE3EryxmD6EwzKIju7H3HluYy3QOTDOSG3qHeZgzbFMgvwITcjSZIe_eFRE66KO_nnh-udoDnH6h6uqdF_XbHRx6y5MY1uR77N2KgyJvSLPASsQ0-GNLoBtbeO__3oNaAC6oPG9yta9OWS_TwsDi1cJhdYV7xq2PggzsSfK8FIGR0 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:38.243237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8272c0b90914361ae6f6c3a062380df", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}] Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 31a5d88c557c45b38724e8dafc0d0296 Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:38.244984 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '907637d1-192e-4a1a-8925-86218c9015a5'} Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:38.245930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:38.247518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:38.249005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Returning 404 to user: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:38.249005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3cd20143-73c2-415c-ae7b-b8d56813b3ad tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 404 len: 111 microversion: 2.20 time: 0.030665 Oct 17 18:03:38.249005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 451/880] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:38 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:03:38.254441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-958f9d5d-e8b8-479f-81d4-b4f6fb682cb7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '.version_select at 0x7f0199966160>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:38.339571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-958f9d5d-e8b8-479f-81d4-b4f6fb682cb7 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964855695" status: 204 len: 0 microversion: 2.20 time: 0.089548 Oct 17 18:03:38.340278 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 430/881] 10.222.0.58 () {60 vars in 1259 bytes} [Mon Oct 17 18:03:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964855695 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 18:03:38.846263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:38.847016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:38.853381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:38.853885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:38.854304 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:38.855084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:38.855539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:38.855962 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:39.023012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:39.031101 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e988195b-a90c-4a5d-aa25-0e597fdad62a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.188851 Oct 17 18:03:39.031661 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 452/882] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:38 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:40.055515 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:40.056120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:40.062976 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:40.063454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:40.063891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:40.064579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:40.065054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:40.065479 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:40.206607 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:40.215513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a23f8c79-9bdd-465a-8614-2b97a3f20246 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.165031 Oct 17 18:03:40.216082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 431/883] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:40 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:40.418028 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:40.418613 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:40.425083 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:40.425561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:40.426067 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:40.426856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:40.427298 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:40.427884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:40.442025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] HTTP exception thrown: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Request method failure captured: Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 HTTP/1.1 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdE3EryxmD6EwzKIju7H3HluYy3QOTDOSG3qHeZgzbFMgvwITcjSZIe_eFRE66KO_nnh-udoDnH6h6uqdF_XbHRx6y5MY1uR77N2KgyJvSLPASsQ0-GNLoBtbeO__3oNaAC6oPG9yta9OWS_TwsDi1cJhdYV7xq2PggzsSfK8FIGR0 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:40.443632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8272c0b90914361ae6f6c3a062380df", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}] Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 31a5d88c557c45b38724e8dafc0d0296 Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.445523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '907637d1-192e-4a1a-8925-86218c9015a5'} Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:40.446701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.447973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.450145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Returning 404 to user: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:40.450145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-206a120d-916a-40d0-9c46-e9d39aad6495 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 404 len: 111 microversion: 2.20 time: 0.030865 Oct 17 18:03:40.450145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 453/884] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 17 18:03:40 2022] DELETE /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:03:40.454039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:40.454665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: 907637d1-192e-4a1a-8925-86218c9015a5] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:40.461783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:40.466669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:40.466669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:40.466669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:40.466669 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:40.467102 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:40.477532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] HTTP exception thrown: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Request method failure captured: Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 HTTP/1.1 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdE3EryxmD6EwzKIju7H3HluYy3QOTDOSG3qHeZgzbFMgvwITcjSZIe_eFRE66KO_nnh-udoDnH6h6uqdF_XbHRx6y5MY1uR77N2KgyJvSLPASsQ0-GNLoBtbeO__3oNaAC6oPG9yta9OWS_TwsDi1cJhdYV7xq2PggzsSfK8FIGR0 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:40.479212 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8272c0b90914361ae6f6c3a062380df", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}] Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 31a5d88c557c45b38724e8dafc0d0296 Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.480974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '907637d1-192e-4a1a-8925-86218c9015a5'} Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:40.481865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. Oct 17 18:03:40.483355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:40.484892 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Returning 404 to user: Instance 907637d1-192e-4a1a-8925-86218c9015a5 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:40.484892 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6b6d11c0-977f-416c-8915-d903c999de72 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5" status: 404 len: 111 microversion: 2.20 time: 0.030622 Oct 17 18:03:40.484892 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 432/885] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:40 2022] GET /compute/v2.1/servers/907637d1-192e-4a1a-8925-86218c9015a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 18:03:41.239160 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:41.239763 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:41.253109 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:41.253634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:41.254638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:41.255364 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:41.255815 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:41.256232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:41.268830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:03:41.391535 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:41.402031 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-68ca9c89-5d14-493c-bdb3-57b1f24897ca tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.166640 Oct 17 18:03:41.402891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 454/886] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:41 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:41.772612 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:41.773114 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:41.779461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:41.779933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:41.780365 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:41.781082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:41.781530 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:41.781951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:41.795305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] HTTP exception thrown: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Request method failure captured: Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da HTTP/1.1 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZdE3EryxmD6EwzKIju7H3HluYy3QOTDOSG3qHeZgzbFMgvwITcjSZIe_eFRE66KO_nnh-udoDnH6h6uqdF_XbHRx6y5MY1uR77N2KgyJvSLPASsQ0-GNLoBtbeO__3oNaAC6oPG9yta9OWS_TwsDi1cJhdYV7xq2PggzsSfK8FIGR0 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:41.796846 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8272c0b90914361ae6f6c3a062380df", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}] Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 31a5d88c557c45b38724e8dafc0d0296 Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.798488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'd932b27f-b1fd-42b4-a8e3-3908063839da'} Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:41.799458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.800990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.802388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Returning 404 to user: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:41.802388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9ffdc59d-a928-4e6e-bdbd-d6b68f0498bf tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 404 len: 111 microversion: 2.20 time: 0.030407 Oct 17 18:03:41.802388 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 433/887] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 17 18:03:41 2022] DELETE /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:03:41.807387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:41.808019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] [instance: d932b27f-b1fd-42b4-a8e3-3908063839da] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:41.814577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:41.815054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:41.817726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:41.817726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:41.817726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:41.817959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:41.831248 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] HTTP exception thrown: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Request method failure captured: Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da HTTP/1.1 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZdE3EryxmD6EwzKIju7H3HluYy3QOTDOSG3qHeZgzbFMgvwITcjSZIe_eFRE66KO_nnh-udoDnH6h6uqdF_XbHRx6y5MY1uR77N2KgyJvSLPASsQ0-GNLoBtbeO__3oNaAC6oPG9yta9OWS_TwsDi1cJhdYV7xq2PggzsSfK8FIGR0 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:41.833723 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8272c0b90914361ae6f6c3a062380df", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8272c0b90914361ae6f6c3a062380df"}]}] Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b8272c0b90914361ae6f6c3a062380df Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763477166 Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 31a5d88c557c45b38724e8dafc0d0296 Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763477166-project Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.835485 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'd932b27f-b1fd-42b4-a8e3-3908063839da'} Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:41.836822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. Oct 17 18:03:41.838054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:41.839989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] Returning 404 to user: Instance d932b27f-b1fd-42b4-a8e3-3908063839da could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:41.839989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1c4ee33f-7764-48c7-9783-89782b2f78a8 tempest-AttachVolumeShelveTestJSON-763477166 tempest-AttachVolumeShelveTestJSON-763477166-project] 10.222.0.58 "GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da" status: 404 len: 111 microversion: 2.20 time: 0.032254 Oct 17 18:03:41.839989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 455/888] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 17 18:03:41 2022] GET /compute/v2.1/servers/d932b27f-b1fd-42b4-a8e3-3908063839da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:03:42.429773 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:42.431675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:42.438814 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:42.439424 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:42.440065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:42.440961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:42.441798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:42.442400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:42.672504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:42.683830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6144bc69-a6cc-4711-aa36-0895b37eb66a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1723 microversion: 2.1 time: 0.260087 Oct 17 18:03:42.684581 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 434/889] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:42 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:03:43.720149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:43.724616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:43.732714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:43.737977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:43.737977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:43.737977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:43.737977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:43.738891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:43.955707 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:43.966701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-760bee2f-ef18-45ff-b235-501a42935bfd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1700 microversion: 2.1 time: 0.261395 Oct 17 18:03:43.969056 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 456/890] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:43 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1700 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:43.992802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8ff85989-11d2-4792-b1fd-3cdfb1a3549b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:44.000504 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8ff85989-11d2-4792-b1fd-3cdfb1a3549b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:44.001305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8ff85989-11d2-4792-b1fd-3cdfb1a3549b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:44.001910 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8ff85989-11d2-4792-b1fd-3cdfb1a3549b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:44.027341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8ff85989-11d2-4792-b1fd-3cdfb1a3549b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Going to try to start instance {{(pid=126522) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 18:03:44.228928 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8ff85989-11d2-4792-b1fd-3cdfb1a3549b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action" status: 202 len: 0 microversion: 2.1 time: 0.241565 Oct 17 18:03:44.236168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 435/891] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:03:43 2022] POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:03:44.244942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:44.245746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:44.263279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:44.263279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:44.263279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:44.263279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:44.263599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:44.263599 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:44.500225 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:44.512676 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9c4eb87d-bfd2-48a9-bb92-c75e1559ab9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1709 microversion: 2.1 time: 0.274963 Oct 17 18:03:44.514322 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 457/892] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:44 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1709 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:45.543189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:45.543897 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:45.560190 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:45.563934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:45.563934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:45.563934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:45.563934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:45.564319 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:45.817902 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:45.828907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-584b9c70-59d9-4834-97d1-f4c1717c7d12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1709 microversion: 2.1 time: 0.292926 Oct 17 18:03:45.829488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 436/893] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:45 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1709 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:46.853747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:46.854355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:03:46.861138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:46.861611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:46.862043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:46.862734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:03:46.863224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:03:46.863681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:03:47.010886 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:03:47.018868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a75f8baa-6624-4a03-a91d-a250b6204749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1713 microversion: 2.1 time: 0.169025 Oct 17 18:03:47.020220 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 458/894] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:03:46 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:03:48.063776 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-64f0e49a-0d8b-4ebe-bf71-e5ee405141ec tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Action: 'create', calling method: .version_select at 0x7f0199980310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-320913566", "metadata": {"Type": "work"}}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-64f0e49a-0d8b-4ebe-bf71-e5ee405141ec tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Request method failure captured: Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 121 Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZkD67rJhrMU_6XlRNM2meOyvi--wxKsIbiufd15SR8UyDiZyK0bhJ1j4C9oWTgm890GPVzihotQAriskzOvqQRFQlEAZCDkGP3JS0EiJI0msDjfHFjDJSOmC7J4vRQSgc9Fl8XDHfgfC9gbqSWRbil9X-m8jStbMgs-3VigVY8U2AY Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:48.083641 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4a80bfc658f4161aebbed18a4579cca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}] Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 704bc3ecd5c74bb5ac936de6a833e529 Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-320913566", "metadata": {"Type": "work"}}} Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 18:03:48.085359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-320913566', 'metadata': {'Type': 'work'}}}} Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise error Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:48.086309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 18:03:48.087882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 18:03:48.090790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 18:03:48.090790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.090790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-64f0e49a-0d8b-4ebe-bf71-e5ee405141ec tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:48.090790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-64f0e49a-0d8b-4ebe-bf71-e5ee405141ec tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136328 Oct 17 18:03:48.090790 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 437/895] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 17 18:03:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:03:48.095527 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f39e60dc-0cad-4cb2-a264-a3e75ffaef04 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Action: 'create', calling method: .version_select at 0x7f0196111a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-708049882", "metadata": {"Type": "work"}}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f39e60dc-0cad-4cb2-a264-a3e75ffaef04 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Request method failure captured: Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 119 Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZkD67rJhrMU_6XlRNM2meOyvi--wxKsIbiufd15SR8UyDiZyK0bhJ1j4C9oWTgm890GPVzihotQAriskzOvqQRFQlEAZCDkGP3JS0EiJI0msDjfHFjDJSOmC7J4vRQSgc9Fl8XDHfgfC9gbqSWRbil9X-m8jStbMgs-3VigVY8U2AY Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:48.100214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4a80bfc658f4161aebbed18a4579cca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}] Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 704bc3ecd5c74bb5ac936de6a833e529 Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-708049882", "metadata": {"Type": "work"}}} Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: Oct 17 18:03:48.101801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-708049882', 'metadata': {'Type': 'work'}}}} Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise error Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi '0' Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:48.102959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 18:03:48.104651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 18:03:48.105869 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 18:03:48.105869 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.105869 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f39e60dc-0cad-4cb2-a264-a3e75ffaef04 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:48.105869 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f39e60dc-0cad-4cb2-a264-a3e75ffaef04 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010048 Oct 17 18:03:48.107202 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 459/896] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 17 18:03:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 18:03:48.111305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ab3e7250-34c6-466a-a674-c6f58e88f310 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Action: 'create', calling method: .version_select at 0x7f019992d550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-244589615", "metadata": {"Type": "work"}}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ab3e7250-34c6-466a-a674-c6f58e88f310 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Request method failure captured: Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 118 Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZkD67rJhrMU_6XlRNM2meOyvi--wxKsIbiufd15SR8UyDiZyK0bhJ1j4C9oWTgm890GPVzihotQAriskzOvqQRFQlEAZCDkGP3JS0EiJI0msDjfHFjDJSOmC7J4vRQSgc9Fl8XDHfgfC9gbqSWRbil9X-m8jStbMgs-3VigVY8U2AY Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:48.115026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4a80bfc658f4161aebbed18a4579cca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}] Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 704bc3ecd5c74bb5ac936de6a833e529 Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-244589615", "metadata": {"Type": "work"}}} Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 18:03:48.119266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-244589615', 'metadata': {'Type': 'work'}}}} Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise error Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi '' Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:48.121213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 18:03:48.122835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 18:03:48.124342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 18:03:48.124342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.124342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ab3e7250-34c6-466a-a674-c6f58e88f310 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:48.124342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ab3e7250-34c6-466a-a674-c6f58e88f310 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008863 Oct 17 18:03:48.124342 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 438/897] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 17 18:03:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 18:03:48.125891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-536ccb12-ead7-42c0-818a-7a7b0b25e24c tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Calling method '.version_select at 0x7f01960fd820>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:48.155437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-536ccb12-ead7-42c0-818a-7a7b0b25e24c tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] HTTP exception thrown: Volume tempest-invalid-1354000669 could not be found. Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-536ccb12-ead7-42c0-818a-7a7b0b25e24c tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Request method failure captured: Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1354000669 HTTP/1.1 Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZkD67rJhrMU_6XlRNM2meOyvi--wxKsIbiufd15SR8UyDiZyK0bhJ1j4C9oWTgm890GPVzihotQAriskzOvqQRFQlEAZCDkGP3JS0EiJI0msDjfHFjDJSOmC7J4vRQSgc9Fl8XDHfgfC9gbqSWRbil9X-m8jStbMgs-3VigVY8U2AY Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:48.158900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4a80bfc658f4161aebbed18a4579cca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}] Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 704bc3ecd5c74bb5ac936de6a833e529 Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Volume tempest-invalid-1354000669 could not be found. Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'tempest-invalid-1354000669'} Oct 17 18:03:48.161061 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1354000669 could not be found. (HTTP 404) (Request-ID: req-e6622ae9-85fb-4664-8f51-8c9caf1f75cf) Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.162005 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 18:03:48.163339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1354000669 could not be found. Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:48.164743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1354000669 could not be found. Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1354000669 could not be found. Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-536ccb12-ead7-42c0-818a-7a7b0b25e24c tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Returning 404 to user: Volume tempest-invalid-1354000669 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-536ccb12-ead7-42c0-818a-7a7b0b25e24c tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1354000669" status: 404 len: 99 microversion: 2.1 time: 0.038835 Oct 17 18:03:48.166153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 460/898] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:03:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1354000669 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 18:03:48.170771 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-141101d1-8edc-4a59-9c13-cd96c7d47327 tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003712 Oct 17 18:03:48.171402 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 439/899] 10.222.0.58 () {58 vars in 1140 bytes} [Mon Oct 17 18:03:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 18:03:48.180333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-66b283f0-7381-44f5-bea1-3230bcfedd7e tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004469 Oct 17 18:03:48.180866 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 461/900] 10.222.0.58 () {58 vars in 1137 bytes} [Mon Oct 17 18:03:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 18:03:48.190250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7f6fd783-bfa5-49ab-9bf8-5b04a489925f tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Calling method '.version_select at 0x7f019992d430>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:48.221485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-7f6fd783-bfa5-49ab-9bf8-5b04a489925f tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] HTTP exception thrown: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7f6fd783-bfa5-49ab-9bf8-5b04a489925f tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Request method failure captured: Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/os-volumes/83b1e868-8bec-499b-8529-6740eb29989c HTTP/1.1 Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZkD67rJhrMU_6XlRNM2meOyvi--wxKsIbiufd15SR8UyDiZyK0bhJ1j4C9oWTgm890GPVzihotQAriskzOvqQRFQlEAZCDkGP3JS0EiJI0msDjfHFjDJSOmC7J4vRQSgc9Fl8XDHfgfC9gbqSWRbil9X-m8jStbMgs-3VigVY8U2AY Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:03:48.224167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4a80bfc658f4161aebbed18a4579cca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}] Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 704bc3ecd5c74bb5ac936de6a833e529 Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '83b1e868-8bec-499b-8529-6740eb29989c'} Oct 17 18:03:48.225788 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. (HTTP 404) (Request-ID: req-87e651d6-49d2-4324-9021-457905951a7f) Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.226674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 18:03:48.227812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 18:03:48.228975 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7f6fd783-bfa5-49ab-9bf8-5b04a489925f tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Returning 404 to user: Volume 83b1e868-8bec-499b-8529-6740eb29989c could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7f6fd783-bfa5-49ab-9bf8-5b04a489925f tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/83b1e868-8bec-499b-8529-6740eb29989c" status: 404 len: 109 microversion: 2.1 time: 0.038988 Oct 17 18:03:48.230108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 440/901] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 18:03:48 2022] DELETE /compute/v2.1/os-volumes/83b1e868-8bec-499b-8529-6740eb29989c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:03:48.235432 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7949fe71-e36a-4fda-b363-9df368679cdb tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Calling method '.version_select at 0x7f01960a8790>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:03:48.263530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-7949fe71-e36a-4fda-b363-9df368679cdb tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] HTTP exception thrown: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7949fe71-e36a-4fda-b363-9df368679cdb tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Request method failure captured: Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/os-volumes/e5b5c6d1-9d22-4a65-b789-48f075425fa9 HTTP/1.1 Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZkD67rJhrMU_6XlRNM2meOyvi--wxKsIbiufd15SR8UyDiZyK0bhJ1j4C9oWTgm890GPVzihotQAriskzOvqQRFQlEAZCDkGP3JS0EiJI0msDjfHFjDJSOmC7J4vRQSgc9Fl8XDHfgfC9gbqSWRbil9X-m8jStbMgs-3VigVY8U2AY Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:03:48.265579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4a80bfc658f4161aebbed18a4579cca", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4a80bfc658f4161aebbed18a4579cca"}]}] Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: b4a80bfc658f4161aebbed18a4579cca Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-VolumesNegativeTest-1230683858 Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 704bc3ecd5c74bb5ac936de6a833e529 Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-VolumesNegativeTest-1230683858-project Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'e5b5c6d1-9d22-4a65-b789-48f075425fa9'} Oct 17 18:03:48.267179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. (HTTP 404) (Request-ID: req-2fa5513b-b21b-49b3-8723-cf682b71e092) Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.268286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 18:03:48.270205 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 18:03:48.271397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7949fe71-e36a-4fda-b363-9df368679cdb tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] Returning 404 to user: Volume e5b5c6d1-9d22-4a65-b789-48f075425fa9 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7949fe71-e36a-4fda-b363-9df368679cdb tempest-VolumesNegativeTest-1230683858 tempest-VolumesNegativeTest-1230683858-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e5b5c6d1-9d22-4a65-b789-48f075425fa9" status: 404 len: 109 microversion: 2.1 time: 0.035518 Oct 17 18:03:48.272867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 462/902] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 17 18:03:48 2022] GET /compute/v2.1/os-volumes/e5b5c6d1-9d22-4a65-b789-48f075425fa9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 18:04:01.127127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:01.127924 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:01.132000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-742697383", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "networks": [{"uuid": "58d56b59-f4f8-4f8c-8e0e-b32f7a5d8070"}]}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:01.187588 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] validate_networks() for [('58d56b59-f4f8-4f8c-8e0e-b32f7a5d8070', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:04:01.896980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:04:01.897404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:04:01.897877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:04:01.898394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:04:01.898813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:04:01.912334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:01.912334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:01.912334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:01.912334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:01.912994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:01.912994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:01.931778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Getting quotas for project ce69ca9e52e34234ab96b7c753dadfd4. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:04:01.936159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Getting quotas for user 853f63d32ef14d0597edad54881aa8bb and project ce69ca9e52e34234ab96b7c753dadfd4. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:04:01.952868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:04:01.955723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:04:02.089715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a4b40701-61dd-46c9-b3c2-ba8accfa7f7d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964149 Oct 17 18:04:02.090362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 441/903] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:04:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:04:02.100302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:02.106959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=25 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:02.106959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-539f35e8-3c04-41cb-a098-fa2dde1c9b09 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:02.106959 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-539f35e8-3c04-41cb-a098-fa2dde1c9b09 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:02.159688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-539f35e8-3c04-41cb-a098-fa2dde1c9b09 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:02.167840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-539f35e8-3c04-41cb-a098-fa2dde1c9b09 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1213 microversion: 2.1 time: 0.070179 Oct 17 18:04:02.168744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 463/904] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:02 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:03.193623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4f8e74e7-0770-44b9-b4f0-52ec71e05e5a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:03.194440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4f8e74e7-0770-44b9-b4f0-52ec71e05e5a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:03.251865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4f8e74e7-0770-44b9-b4f0-52ec71e05e5a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:03.260734 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4f8e74e7-0770-44b9-b4f0-52ec71e05e5a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1213 microversion: 2.1 time: 0.071758 Oct 17 18:04:03.261297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 442/905] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:03 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:04.291940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:04.292541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:04.299796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:04.300275 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:04.301084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:04.301782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:04.302222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:04.302639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:04.370185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:04.377944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5ca73342-e017-4dd8-b18d-a956346c36f6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1265 microversion: 2.1 time: 0.091650 Oct 17 18:04:04.378507 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 464/906] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:04 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:05.406286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:05.406831 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:05.413171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:05.413649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:05.414077 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:05.415916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:05.416376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:05.416858 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:05.603317 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:05.611177 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-49753f65-f591-4a31-a1d6-8f7668f91d00 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.208804 Oct 17 18:04:05.611754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 443/907] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:05 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:06.307013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-3379291d-72b5-4c03-9583-0823d372f37f req-b3418060-2a77-48da-9929-7e16a9eae176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d91cb7-4b5f-4c11-8f9e-082d519aef93", "tag": "46c76e68-057c-4ea7-8ea1-042c99a4c054"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:06.317286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-3379291d-72b5-4c03-9583-0823d372f37f req-b3418060-2a77-48da-9929-7e16a9eae176 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:06.317757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-3379291d-72b5-4c03-9583-0823d372f37f req-b3418060-2a77-48da-9929-7e16a9eae176 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:06.318181 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-3379291d-72b5-4c03-9583-0823d372f37f req-b3418060-2a77-48da-9929-7e16a9eae176 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:06.331796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-3379291d-72b5-4c03-9583-0823d372f37f req-b3418060-2a77-48da-9929-7e16a9eae176 service nova] Creating event network-changed:46c76e68-057c-4ea7-8ea1-042c99a4c054 for instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 on hv-cinder-86160 Oct 17 18:04:06.337583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-3379291d-72b5-4c03-9583-0823d372f37f req-b3418060-2a77-48da-9929-7e16a9eae176 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035517 Oct 17 18:04:06.338201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 465/908] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:04:06.634828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:06.635351 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:06.642942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:06.644154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:06.644154 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:06.644529 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:06.645004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:06.645428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:06.866479 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:06.875160 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-101317b7-5230-4e0e-8c5e-6477dfb47ef6 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.244939 Oct 17 18:04:06.880329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 444/909] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:06 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:07.904084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:07.904878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:07.911589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:07.912091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:07.920242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:07.920242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:07.920242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:07.920242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:08.084470 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:08.093619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5839086b-c2ba-4b81-b119-ea5a5393c9ba tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.194042 Oct 17 18:04:08.094558 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 466/910] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:07 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:09.115550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:09.116156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:09.123427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:09.123841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:09.124271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:09.125031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:09.125486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:09.125911 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:09.410932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:09.419147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d8cec12c-9380-47dc-ac87-921f629a8114 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.307381 Oct 17 18:04:09.424970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 445/911] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:09 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:10.441897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:10.442500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:10.450713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:10.451257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:10.451687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:10.452684 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:10.453129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:10.453543 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:10.591238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:10.600729 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3295ff38-b1ad-4096-8231-fdb696e12b51 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.162755 Oct 17 18:04:10.601517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 467/912] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:10 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:11.623961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:11.624606 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:11.631078 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:11.631557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:11.632006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:11.632699 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:11.633152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:11.633579 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:11.766265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:11.773911 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bef97e23-81b9-4821-8137-260af19e8a48 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.153742 Oct 17 18:04:11.775012 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 446/913] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:11 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:12.797419 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:12.798167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:12.800645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:12.805377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:12.806388 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:12.807209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:12.807910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:12.808394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:12.808848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:12.893830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-9a05c85b-b0fe-4918-b157-498d2f289ebc req-18e0ed3d-d3fe-4abc-a288-e41e6345636c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d91cb7-4b5f-4c11-8f9e-082d519aef93", "name": "network-vif-plugged", "status": "completed", "tag": "46c76e68-057c-4ea7-8ea1-042c99a4c054"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:12.903113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:12.905797 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-9a05c85b-b0fe-4918-b157-498d2f289ebc req-18e0ed3d-d3fe-4abc-a288-e41e6345636c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:12.906538 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-9a05c85b-b0fe-4918-b157-498d2f289ebc req-18e0ed3d-d3fe-4abc-a288-e41e6345636c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:12.907375 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-9a05c85b-b0fe-4918-b157-498d2f289ebc req-18e0ed3d-d3fe-4abc-a288-e41e6345636c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:12.920125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-9a05c85b-b0fe-4918-b157-498d2f289ebc req-18e0ed3d-d3fe-4abc-a288-e41e6345636c service nova] Creating event network-vif-plugged:46c76e68-057c-4ea7-8ea1-042c99a4c054 for instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 on hv-cinder-86160 Oct 17 18:04:12.925171 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-9a05c85b-b0fe-4918-b157-498d2f289ebc req-18e0ed3d-d3fe-4abc-a288-e41e6345636c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035271 Oct 17 18:04:12.930555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 447/914] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:04:12.959173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:12.965741 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b2feff39-3858-4dd3-91e3-956190bf7dea tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.172167 Oct 17 18:04:12.966301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 468/915] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:12 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:13.986529 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=8 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:13.991506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:13.992240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:13.999286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:13.999760 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:14.000197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:14.001079 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:14.001536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:14.001962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:14.132507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:14.140309 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b156cde1-6109-4d76-b3e3-7c887c336855 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1313 microversion: 2.1 time: 0.154806 Oct 17 18:04:14.140893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 448/916] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:13 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:15.162730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:15.163327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:15.170533 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:15.170666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:15.170999 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:15.171688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:15.172137 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:15.172555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:15.307004 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:15.315499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f5c806b8-5d9e-42df-a7e6-89473ad568f4 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1496 microversion: 2.1 time: 0.156587 Oct 17 18:04:15.316403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 469/917] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:15 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:16.299420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:16.299920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:16.306866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:16.307353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:16.310604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:16.310604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:16.310604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:16.310604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:16.336358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:04:16.717371 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e36c4348-d4db-4b29-8d9c-784d8386ef2f tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 204 len: 0 microversion: 2.1 time: 0.422361 Oct 17 18:04:16.718030 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 449/918] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:04:16 2022] DELETE /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:04:16.726563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:16.727169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:16.733734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:16.734645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:16.735094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:16.735921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:16.736373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:16.736827 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:16.899522 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:16.908933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-621efb29-606b-4061-bebb-2e35a44e517a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1502 microversion: 2.1 time: 0.186285 Oct 17 18:04:16.909911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 470/919] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:16 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:17.932944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:17.934199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:17.940815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:17.941298 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:17.941737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:17.942541 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:17.942959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:17.943389 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:18.076964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:18.085793 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-95b7e497-25cb-4f40-a699-8ec4958b25ff tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1502 microversion: 2.1 time: 0.157506 Oct 17 18:04:18.086364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 450/920] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:17 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:19.111797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:19.112398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:19.118615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:19.119089 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:19.119515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:19.120195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:19.120664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:19.121086 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:19.254026 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:19.261704 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4d22215e-7779-4d02-8475-002a93b2d4fa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1502 microversion: 2.1 time: 0.153754 Oct 17 18:04:19.262307 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 471/921] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:19 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:20.285909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:20.286776 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:20.294142 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:20.294798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:20.295274 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:20.296186 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:20.298901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:20.298901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:20.451348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:20.460682 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:20.461199 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:20.462437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-119f0920-51b2-4aa8-b877-713b25e6e8e9 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1502 microversion: 2.1 time: 0.180513 Oct 17 18:04:20.468423 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:20.470716 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:20.470716 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:20.471084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:20.471337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:20.472351 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:20.477784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 451/922] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:20 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:20.567548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lazy-loading 'services' on Instance uuid ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:04:20.807624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-aefb2ad9-fefb-43fa-b32d-0312fa9ac00a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-volume_attachments/da420f9a-df3e-42e7-9948-2fa387d6e6a6" status: 202 len: 0 microversion: 2.1 time: 0.351034 Oct 17 18:04:20.808461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 472/923] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:04:20 2022] DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-volume_attachments/da420f9a-df3e-42e7-9948-2fa387d6e6a6 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:04:21.489443 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:21.490854 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:21.504604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:21.506655 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:21.507344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:21.508859 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:21.509550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:21.510219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:21.554916 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-a6db05c4-939c-46dd-bbe6-9dcb200493da req-68a8ea2c-4d64-47db-9ffa-7a36aa5aab66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d91cb7-4b5f-4c11-8f9e-082d519aef93", "name": "network-vif-deleted", "tag": "46c76e68-057c-4ea7-8ea1-042c99a4c054"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:21.607901 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a6db05c4-939c-46dd-bbe6-9dcb200493da req-68a8ea2c-4d64-47db-9ffa-7a36aa5aab66 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:21.608487 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a6db05c4-939c-46dd-bbe6-9dcb200493da req-68a8ea2c-4d64-47db-9ffa-7a36aa5aab66 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:21.608951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-a6db05c4-939c-46dd-bbe6-9dcb200493da req-68a8ea2c-4d64-47db-9ffa-7a36aa5aab66 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:21.630717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-a6db05c4-939c-46dd-bbe6-9dcb200493da req-68a8ea2c-4d64-47db-9ffa-7a36aa5aab66 service nova] Creating event network-vif-deleted:46c76e68-057c-4ea7-8ea1-042c99a4c054 for instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 on hv-cinder-86160 Oct 17 18:04:21.636143 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-a6db05c4-939c-46dd-bbe6-9dcb200493da req-68a8ea2c-4d64-47db-9ffa-7a36aa5aab66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086334 Oct 17 18:04:21.638252 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 473/924] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:04:21.696015 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:21.705350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f8536bc1-a809-46fe-8ef1-4279c0a0e02d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1460 microversion: 2.1 time: 0.220639 Oct 17 18:04:21.705939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 452/925] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:21 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1460 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:22.154236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6d5f547d-c317-4e92-b6a8-b96ccee4812a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:22.163162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6d5f547d-c317-4e92-b6a8-b96ccee4812a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:22.164015 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6d5f547d-c317-4e92-b6a8-b96ccee4812a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:22.164872 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6d5f547d-c317-4e92-b6a8-b96ccee4812a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:22.250928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6d5f547d-c317-4e92-b6a8-b96ccee4812a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Going to try to stop instance {{(pid=126519) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 18:04:22.490213 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6d5f547d-c317-4e92-b6a8-b96ccee4812a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action" status: 202 len: 0 microversion: 2.1 time: 0.341523 Oct 17 18:04:22.497174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 474/926] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:04:22 2022] POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:04:22.508709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:22.511578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:22.533705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:22.539667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:22.539667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:22.539667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:22.539667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:22.540158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:22.716569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:22.731206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:22.738098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:22.739576 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-44e2c519-ab59-4921-ac7f-4502c0791551 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.243443 Oct 17 18:04:22.740170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 453/927] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:22 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:22.751914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:22.751914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:22.751914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:22.751914 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:22.752721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:22.752721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:22.794032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:22.794032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:22.794032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:22.794032 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lazy-loading 'fault' on Instance uuid a9d91cb7-4b5f-4c11-8f9e-082d519aef93 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:04:23.125016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:23.129209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9330639e-4543-4d9c-949d-9a5aff4d85b5 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 200 len: 1303 microversion: 2.1 time: 0.402642 Oct 17 18:04:23.129782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 475/928] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:22 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 1303 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:23.770225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:23.771663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:23.781455 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:23.782353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:23.783132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:23.784269 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:23.785037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:23.785876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:24.067512 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:24.077020 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fc4c74e7-92b4-4803-96ea-f413b66256cd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.313615 Oct 17 18:04:24.091234 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 454/929] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:23 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:24.155040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:24.156300 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: a9d91cb7-4b5f-4c11-8f9e-082d519aef93] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:24.162817 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:24.163531 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:24.163969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:24.164878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:24.165339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:24.165763 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:24.179883 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] HTTP exception thrown: Instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 could not be found. Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Request method failure captured: Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 HTTP/1.1 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZkPp5WjnhS_qGNs69hN-_rxMdG-z9Qzy-cxpYV7cxBGY3woAFSqRqJI63bP1d8L8Mwa7gJCKZjv1Ys0dOwreqT2iSA80J0Z6JK7olt8WH2nXxe92-z6Qx-ErdK6C4G71m0PoEJJHWCJzurmaO8uw8y3jpfFyQg3U-1_KhlogPBCl58 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: ce69ca9e52e34234ab96b7c753dadfd4 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-VolumesActionsTest-771280145 Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:04:24.181834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce69ca9e52e34234ab96b7c753dadfd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce69ca9e52e34234ab96b7c753dadfd4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce69ca9e52e34234ab96b7c753dadfd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce69ca9e52e34234ab96b7c753dadfd4"}]}] Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-VolumesActionsTest-771280145 Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: ce69ca9e52e34234ab96b7c753dadfd4 Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-VolumesActionsTest-771280145 Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-VolumesActionsTest-771280145-project Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 853f63d32ef14d0597edad54881aa8bb Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-VolumesActionsTest-771280145-project Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 could not be found. Oct 17 18:04:24.183285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'a9d91cb7-4b5f-4c11-8f9e-082d519aef93'} Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 could not be found. Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:04:24.184168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 could not be found. Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 could not be found. Oct 17 18:04:24.186594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:04:24.188692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Returning 404 to user: Instance a9d91cb7-4b5f-4c11-8f9e-082d519aef93 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:04:24.188692 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8aabae5b-ef08-4a91-b28b-af6a7b6e54fd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93" status: 404 len: 111 microversion: 2.1 time: 0.032177 Oct 17 18:04:24.194439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 476/930] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:24 2022] GET /compute/v2.1/servers/a9d91cb7-4b5f-4c11-8f9e-082d519aef93 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:04:24.302123 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1514213779", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "networks": [{"uuid": "58d56b59-f4f8-4f8c-8e0e-b32f7a5d8070"}]}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:24.370465 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] validate_networks() for [('58d56b59-f4f8-4f8c-8e0e-b32f7a5d8070', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:04:24.941815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:04:24.942432 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:04:24.942694 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:04:24.943108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:04:24.943522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:04:24.953608 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:24.954099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:24.954536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:24.955294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:24.955747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:24.956813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:24.974050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Getting quotas for project ce69ca9e52e34234ab96b7c753dadfd4. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:04:24.977959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Getting quotas for user 853f63d32ef14d0597edad54881aa8bb and project ce69ca9e52e34234ab96b7c753dadfd4. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:04:24.989819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:04:24.991904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:04:25.100580 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:25.101790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:25.110457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:25.114173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:25.114173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:25.114173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:25.114173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:25.114571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:25.125138 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-94160af3-9fe3-4026-9abb-d2f5326e9063 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827571 Oct 17 18:04:25.126912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 455/931] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:04:25.141159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-64723589-d069-41c3-9a0e-7c015c4db2bf tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:25.145234 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-64723589-d069-41c3-9a0e-7c015c4db2bf tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:25.301653 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-64723589-d069-41c3-9a0e-7c015c4db2bf tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:25.310464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-64723589-d069-41c3-9a0e-7c015c4db2bf tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1214 microversion: 2.1 time: 0.174938 Oct 17 18:04:25.311263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 456/932] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:25 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:25.394671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:25.402461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8cb1ead5-44f8-42d0-9ee8-090aa3e7cea0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.306064 Oct 17 18:04:25.404036 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 477/933] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:25 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:26.094469 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1667903800", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1896343550", "security_groups": [{"name": "tempest-secgroup-smoke-490657498"}], "block_device_mapping_v2": [{"uuid": "b05ed75e-a6bd-4153-be23-73a5ba6a6738", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a5134453-24e2-45e3-8067-3e320705eb69"}]}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:26.320762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] validate_networks() for [('a5134453-24e2-45e3-8067-3e320705eb69', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:04:26.333227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:26.333842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:26.340401 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:26.341785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:26.342392 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:26.353214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:26.354907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:26.359067 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:26.648460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:26.660790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5b4326f5-5200-475d-94b3-c5dbd65da97d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1218 microversion: 2.1 time: 0.331178 Oct 17 18:04:26.681359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 478/934] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:26 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:26.688203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:26.689152 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:26.696228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:26.697058 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:26.697712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:26.698644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:26.699315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:26.700785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:26.925616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:26.934978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-24b141a7-1711-437c-a25d-2c44e9d51bfc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.251401 Oct 17 18:04:26.938855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 479/935] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:26 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:26.984965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:04:26.985450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:04:26.985859 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:04:26.986294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:04:26.986974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:04:26.995796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:26.998441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:26.998441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:26.998441 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:26.998752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:26.999010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:27.016450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for project 1c70a04a649248c6a629325d44c380b9. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:04:27.020245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Getting quotas for user ec7790cac2cb4e7cb68b5a2e3a91d5ec and project 1c70a04a649248c6a629325d44c380b9. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:04:27.077396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:04:27.079477 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b05ed75e-a6bd-4153-be23-73a5ba6a6738',volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:04:27.580666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b0651a42-8dcd-4b72-b0b9-da4099dff320 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.491830 Oct 17 18:04:27.582339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 457/936] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:04:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 18:04:27.594365 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3bdc7ada-c725-4d2c-b3f1-cf0de005c7c2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:27.594973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3bdc7ada-c725-4d2c-b3f1-cf0de005c7c2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:27.671027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3bdc7ada-c725-4d2c-b3f1-cf0de005c7c2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:27.680279 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3bdc7ada-c725-4d2c-b3f1-cf0de005c7c2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1095 microversion: 2.1 time: 0.090609 Oct 17 18:04:27.689203 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 480/937] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:27 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:27.690052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:27.690672 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:27.703496 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:27.703926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:27.704370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:27.705108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:27.711557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:27.712013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:27.822477 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:27.831805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-efa5050f-d6e4-4bd8-bfdd-7a69f2c3ebd2 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1266 microversion: 2.1 time: 0.147357 Oct 17 18:04:27.833434 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 458/938] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:27 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:27.960743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:27.961746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:27.970118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:27.970607 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:27.971039 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:27.971898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:27.972359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:27.972809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:27.993296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:28.168743 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:28.182683 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3e473f14-fcf4-48f2-97e1-c16c4784f285 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.225233 Oct 17 18:04:28.183713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 481/939] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:27 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:28.706316 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-343df8a7-8cae-4056-843a-b9142ffd557f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:28.707993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-343df8a7-8cae-4056-843a-b9142ffd557f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:28.803283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-343df8a7-8cae-4056-843a-b9142ffd557f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:28.814296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-343df8a7-8cae-4056-843a-b9142ffd557f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1095 microversion: 2.1 time: 0.114046 Oct 17 18:04:28.815047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 459/940] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:28 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1095 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:28.867337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:28.868461 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:28.894417 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:28.895285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:28.896019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:28.897224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:28.897689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:28.898131 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:28.995371 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:29.006012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-44bf4cc6-ac1d-4336-b92b-4f334066634c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1272 microversion: 2.1 time: 0.152807 Oct 17 18:04:29.006982 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 482/941] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:28 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:29.208663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:29.209255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:29.215346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:29.216851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:29.217557 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:29.218703 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:29.219583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:29.220394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:29.548967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:29.557906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9fa801c0-1cb4-4ad1-8a54-c45d832748b1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.353172 Oct 17 18:04:29.572930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 460/942] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:29 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:29.839475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:29.840376 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:29.869622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:29.869622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:29.869622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:29.869622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:29.870344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:29.870344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:30.008429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:30.019874 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cfbea795-0623-4e70-8b25-f69c1740930e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1193 microversion: 2.1 time: 0.184310 Oct 17 18:04:30.020457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 483/943] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:29 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1193 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:30.031838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:30.033563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:30.045737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:30.048216 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:30.048987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:30.051801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:30.052291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:30.052812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:30.133256 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:30.585169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:30.585994 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:30.593315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:30.594323 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:30.594958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:30.595817 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:30.596430 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:30.597033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:31.009148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:31.020407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ea7b2687-5ea8-420c-9a9b-238d4b24f2de tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.992958 Oct 17 18:04:31.022170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 461/944] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:30 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:31.048427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:31.049127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:31.053295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:31.057407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:31.057900 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:31.058376 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:31.059084 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:31.060149 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:31.060609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:31.113076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:31.122870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-313bc5ef-9c2b-4402-bdf0-f82e66338e7a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.540224 Oct 17 18:04:31.125953 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 484/945] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:30 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:31.159982 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:31.174680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3d542fbf-1e98-43e3-9727-1d4f1535f537 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1211 microversion: 2.1 time: 0.130950 Oct 17 18:04:31.181113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 462/946] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:31 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:31.676759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-0f619ee7-7696-482f-b7ef-1f221c854e18 req-ae52343b-5054-4b8d-aeb8-0ca509381653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e979313e-0b00-43f1-ad76-ab5d32f893f2", "tag": "a6d0b85b-424a-4a8b-b193-0781ea0b8a4b"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:31.693360 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-0f619ee7-7696-482f-b7ef-1f221c854e18 req-ae52343b-5054-4b8d-aeb8-0ca509381653 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:31.694175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-0f619ee7-7696-482f-b7ef-1f221c854e18 req-ae52343b-5054-4b8d-aeb8-0ca509381653 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:31.694962 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-0f619ee7-7696-482f-b7ef-1f221c854e18 req-ae52343b-5054-4b8d-aeb8-0ca509381653 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:31.707620 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-0f619ee7-7696-482f-b7ef-1f221c854e18 req-ae52343b-5054-4b8d-aeb8-0ca509381653 service nova] Creating event network-changed:a6d0b85b-424a-4a8b-b193-0781ea0b8a4b for instance e979313e-0b00-43f1-ad76-ab5d32f893f2 on hv-cinder-86160 Oct 17 18:04:31.717801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-0f619ee7-7696-482f-b7ef-1f221c854e18 req-ae52343b-5054-4b8d-aeb8-0ca509381653 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050318 Oct 17 18:04:31.725095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 485/947] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:04:32.047190 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:32.047944 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:32.057255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:32.057942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:32.058328 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:32.059210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:32.060104 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:32.060979 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:32.149796 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:32.150754 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:32.158200 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:32.158940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:32.159835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:32.161146 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:32.161907 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:32.162541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:32.672418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:32.674464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:32.683922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f038b8d9-35f2-4a40-bb4f-93cf291f17a6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1677 microversion: 2.1 time: 0.539370 Oct 17 18:04:32.685418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 486/948] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:32 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1677 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:32.702193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8d290255-4aef-45e3-ae4d-a364c88b7760 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.660651 Oct 17 18:04:32.703042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 463/949] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:32 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:32.705357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:32.706178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:32.720571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:32.721152 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:32.721621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:32.722373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:32.722832 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:32.723841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:33.173072 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:33.182930 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-98340055-4029-4039-8e11-a46101bf9ff4 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.495864 Oct 17 18:04:33.183600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 487/950] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:32 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:33.707887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:33.708620 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:33.715673 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:33.716245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:33.716909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:33.717663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:33.718096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:33.718521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:33.734977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:33.734977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:33.737782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:33.738594 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:33.739234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:33.740195 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:33.741021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:33.741655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:34.210693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:34.220059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d1094512-b46e-4941-bae0-f109f59d3a75 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1654 microversion: 2.1 time: 0.516376 Oct 17 18:04:34.221065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 464/951] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:33 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1654 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:34.227999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:34.227999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:34.229331 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:34.234715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:34.235205 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:34.235640 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:34.236333 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:34.236819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:34.237241 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:34.240980 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-19e589a3-402d-4270-bd5c-9e2120c08b2e tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.516932 Oct 17 18:04:34.241824 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 488/952] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:33 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:34.263980 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d24b2271-6b4e-4231-8138-3f5af8cc60c6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:34.271045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d24b2271-6b4e-4231-8138-3f5af8cc60c6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:34.271884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d24b2271-6b4e-4231-8138-3f5af8cc60c6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:34.272562 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d24b2271-6b4e-4231-8138-3f5af8cc60c6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:34.298972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d24b2271-6b4e-4231-8138-3f5af8cc60c6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Going to try to start instance {{(pid=126519) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 18:04:34.485474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d24b2271-6b4e-4231-8138-3f5af8cc60c6 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action" status: 202 len: 0 microversion: 2.1 time: 0.235955 Oct 17 18:04:34.485474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 489/953] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:04:34 2022] POST /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:04:34.489180 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:34.490341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:34.492855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=61 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:34.499053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:34.499852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:34.500667 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:34.501689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:34.502080 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:34.502664 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:34.528879 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:34.538010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-148d0114-6c5e-43f1-bb2c-c59e7b491714 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.315751 Oct 17 18:04:34.538592 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 465/954] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:34 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:34.804777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:34.818049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d0f19d60-a571-4b14-a673-61a45111fa47 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1663 microversion: 2.1 time: 0.333092 Oct 17 18:04:34.829091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 490/955] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:34 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1663 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:35.271686 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:35.272245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:35.279350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.279843 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.280278 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:35.281583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.281583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.281954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:35.486686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-fa1ec346-83af-4e57-8328-ed8329f07d39 req-f292aeed-b059-4a3a-b7bf-8ae241827cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd55b7a8-181b-4125-9eeb-ab9d766f8d81", "tag": "db33472c-c494-43af-8f07-e9443ae30e6d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:35.496756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-fa1ec346-83af-4e57-8328-ed8329f07d39 req-f292aeed-b059-4a3a-b7bf-8ae241827cbf service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.497236 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-fa1ec346-83af-4e57-8328-ed8329f07d39 req-f292aeed-b059-4a3a-b7bf-8ae241827cbf service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.497663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-fa1ec346-83af-4e57-8328-ed8329f07d39 req-f292aeed-b059-4a3a-b7bf-8ae241827cbf service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:35.508716 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-fa1ec346-83af-4e57-8328-ed8329f07d39 req-f292aeed-b059-4a3a-b7bf-8ae241827cbf service nova] Creating event network-changed:db33472c-c494-43af-8f07-e9443ae30e6d for instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 on hv-cinder-86160 Oct 17 18:04:35.514156 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-fa1ec346-83af-4e57-8328-ed8329f07d39 req-f292aeed-b059-4a3a-b7bf-8ae241827cbf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031232 Oct 17 18:04:35.514734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 491/956] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:04:35.562209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:35.563758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:35.570025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.570518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.570948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:35.571644 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.572099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.572510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:35.705547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:35.725993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c779f278-312a-4a54-be4b-1b847ad07747 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.458212 Oct 17 18:04:35.726648 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 466/957] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:35 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:35.846604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:35.847235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:35.853157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.853638 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.854068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:35.858922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:35.858922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:35.858922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:36.063537 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:36.072621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9664234b-e5c9-4ad5-ba4d-bb59c4f4fe56 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.514694 Oct 17 18:04:36.073143 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 492/958] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:35 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:36.567033 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:36.574730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e471e736-c78c-4550-841b-2fb5ececdb25 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1663 microversion: 2.1 time: 0.732295 Oct 17 18:04:36.575300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 467/959] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:35 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1663 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:36.751073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:36.752237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:36.768511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:36.769294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:36.769909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:36.771012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:36.771621 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:36.772896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:37.084248 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:37.094103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-75c83fee-a36e-41af-9abc-6112730e3898 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.347563 Oct 17 18:04:37.094970 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 493/960] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:36 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:37.100233 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:37.102554 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:37.110482 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=4 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:37.112542 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:37.113339 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:37.113839 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:37.114609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:37.115133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:37.115620 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:37.277029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:37.287714 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4e853835-ab15-418e-926d-8f027747ded6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.195484 Oct 17 18:04:37.288520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 468/961] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:37 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:37.605440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:37.611166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:37.623745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:37.624499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:37.625179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:37.626189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:37.627557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:37.630713 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:37.680531 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:37.873112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:37.892413 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5b71c10a-9816-4623-a063-87d9b6406ffc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1663 microversion: 2.1 time: 0.297109 Oct 17 18:04:37.893815 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 494/962] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:37 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1663 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:38.118696 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:38.119310 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:38.126125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:38.126614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:38.127048 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:38.127756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:38.128219 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:38.128671 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:38.314590 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:38.315519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:38.319647 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:38.322997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:38.323801 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:38.325281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:38.326231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:38.326911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:38.327570 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:38.334505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e98044ab-fb0a-4898-83e7-095154f9b86a tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.218327 Oct 17 18:04:38.335101 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 469/963] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:38 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:38.523339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:38.532302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-49b96ed1-1fe8-40cd-8824-382a3a83e172 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.221783 Oct 17 18:04:38.548291 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 495/964] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:38 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:38.917959 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:38.919239 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:38.923087 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=16 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:38.929822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:38.933489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:38.934492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:38.935234 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:38.935694 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:38.937560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:39.015542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-f2483e3f-b89c-411f-9fb0-f927dbcf526e req-cda36a87-66cc-48cc-b59f-7ab037ddc236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e979313e-0b00-43f1-ad76-ab5d32f893f2", "name": "network-vif-plugged", "status": "completed", "tag": "a6d0b85b-424a-4a8b-b193-0781ea0b8a4b"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:39.032491 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f2483e3f-b89c-411f-9fb0-f927dbcf526e req-cda36a87-66cc-48cc-b59f-7ab037ddc236 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:39.038242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f2483e3f-b89c-411f-9fb0-f927dbcf526e req-cda36a87-66cc-48cc-b59f-7ab037ddc236 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:39.038807 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f2483e3f-b89c-411f-9fb0-f927dbcf526e req-cda36a87-66cc-48cc-b59f-7ab037ddc236 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:39.052760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-f2483e3f-b89c-411f-9fb0-f927dbcf526e req-cda36a87-66cc-48cc-b59f-7ab037ddc236 service nova] Creating event network-vif-plugged:a6d0b85b-424a-4a8b-b193-0781ea0b8a4b for instance e979313e-0b00-43f1-ad76-ab5d32f893f2 on hv-cinder-86160 Oct 17 18:04:39.062645 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-f2483e3f-b89c-411f-9fb0-f927dbcf526e req-cda36a87-66cc-48cc-b59f-7ab037ddc236 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050758 Oct 17 18:04:39.064292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 496/965] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:04:39.154693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:39.164258 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-31ffdf58-bcff-4315-9711-3ab7445d112e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1667 microversion: 2.1 time: 0.250326 Oct 17 18:04:39.165353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 470/966] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:38 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1667 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:39.366284 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:39.367246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:39.377874 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:39.378745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:39.379391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:39.380306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:39.381082 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:39.381709 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:39.555509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:39.556423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:39.566795 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:39.567679 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:39.568341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:39.569372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:39.570055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:39.570795 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:39.668204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:39.691538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-dc0b0be4-bf81-4288-bdef-57b6b9d9119d tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.330403 Oct 17 18:04:39.695558 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 497/967] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:39 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:39.756167 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:39.766868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a2b63688-ec87-42e3-afd1-99be6714c3ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.215202 Oct 17 18:04:39.767937 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 471/968] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:39 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:40.717591 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:40.718766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:40.728982 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:40.729752 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:40.730406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:40.732093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:40.732744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:40.733380 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:40.791277 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:40.792801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:40.800166 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:40.801072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:40.802652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:40.803723 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:40.805190 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:40.805850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:40.953129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:40.970115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5656cb0e-c9c3-485a-9635-b615eeb9f0bd tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1314 microversion: 2.1 time: 0.257766 Oct 17 18:04:40.970943 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 498/969] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:40 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:41.033900 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:41.047780 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e21e44d2-fd16-4b95-83d8-2710624bef63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.260231 Oct 17 18:04:41.048383 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 472/970] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:40 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:41.995601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:41.997110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:42.004162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:42.004677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:42.005294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:42.006204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:42.006913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:42.007334 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:42.012694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:42.072715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:42.073257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:42.081875 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:42.082657 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:42.083240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:42.084098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:42.084742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:42.085161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:42.236263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:42.245132 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d406b075-0d1e-4980-9b66-87e61392326c tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1497 microversion: 2.1 time: 0.255203 Oct 17 18:04:42.246354 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 499/971] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:41 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:42.278510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:42.289124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-092646b6-2cad-4d50-b2d9-43f9477f8b63 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.220481 Oct 17 18:04:42.304564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 473/972] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:42 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:43.125762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:43.126319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:43.134224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:43.135038 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:43.135837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:43.136811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:43.138625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:43.139151 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:43.172568 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:04:43.314338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:43.315155 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:43.326096 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:43.326864 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:43.330698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:43.330698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:43.330698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:43.330698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:43.527396 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:43.528174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3eeeba32-9894-4bb0-a305-01ffa8ee35aa tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 204 len: 0 microversion: 2.1 time: 0.407475 Oct 17 18:04:43.535586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 500/973] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:04:43 2022] DELETE /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:04:43.539217 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ba83e0ce-9d4f-4fd5-b875-7b57432f7629 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.228151 Oct 17 18:04:43.541297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 474/974] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:43 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:43.541946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:43.542860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:43.549475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:43.550196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:43.550886 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:43.551737 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:43.552351 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:43.552967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:43.714726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:43.725837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-67058895-6136-4a17-8a05-d27e65858784 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1503 microversion: 2.1 time: 0.188892 Oct 17 18:04:43.726614 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 501/975] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:43 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:44.564766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:44.565326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:44.571355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:44.571827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:44.572257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:44.572986 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:44.573437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:44.573862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:44.717549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:44.727762 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-34df25f9-d471-47a3-8e98-4d71f17076ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.165027 Oct 17 18:04:44.728379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 475/976] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:44 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:44.750785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:44.752244 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:44.758773 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:44.759263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:44.759700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:44.760394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:44.760880 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:44.761308 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:44.916586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:44.926106 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c20ee18d-9bf8-4090-be9d-bc4cbb192f37 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1503 microversion: 2.1 time: 0.179651 Oct 17 18:04:44.929162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 502/977] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:44 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:45.751676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:45.752429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:45.761473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:45.762941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:45.763238 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:45.764046 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:45.764578 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:45.765099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:45.955611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:45.957040 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:45.966546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:45.967784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:45.968308 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:45.969638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:45.973298 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:45.974048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:46.004972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:46.013758 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5432f8e9-82a9-41a5-8886-4f9df71e7e3f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.267049 Oct 17 18:04:46.014337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 476/978] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:45 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:46.177609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:46.190397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-12525c82-b8b6-44ac-98f4-46ba8330efa3 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1503 microversion: 2.1 time: 0.242787 Oct 17 18:04:46.207332 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 503/979] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:45 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:46.444726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-c749bcfa-b357-4ba0-84e4-fc1463604af5 req-5f88f96c-892b-48fe-b7f1-f0d6328477e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e979313e-0b00-43f1-ad76-ab5d32f893f2", "name": "network-vif-deleted", "tag": "a6d0b85b-424a-4a8b-b193-0781ea0b8a4b"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:46.455498 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c749bcfa-b357-4ba0-84e4-fc1463604af5 req-5f88f96c-892b-48fe-b7f1-f0d6328477e6 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:46.455983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c749bcfa-b357-4ba0-84e4-fc1463604af5 req-5f88f96c-892b-48fe-b7f1-f0d6328477e6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:46.456424 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c749bcfa-b357-4ba0-84e4-fc1463604af5 req-5f88f96c-892b-48fe-b7f1-f0d6328477e6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:46.471435 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-c749bcfa-b357-4ba0-84e4-fc1463604af5 req-5f88f96c-892b-48fe-b7f1-f0d6328477e6 service nova] Creating event network-vif-deleted:a6d0b85b-424a-4a8b-b193-0781ea0b8a4b for instance e979313e-0b00-43f1-ad76-ab5d32f893f2 on hv-cinder-86160 Oct 17 18:04:46.477127 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-c749bcfa-b357-4ba0-84e4-fc1463604af5 req-5f88f96c-892b-48fe-b7f1-f0d6328477e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036337 Oct 17 18:04:46.477774 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 477/980] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:04:47.037852 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:47.039257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:47.050281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:47.053572 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:47.054790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:47.055758 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:47.056423 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:47.057283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:47.211656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:47.218656 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:47.219467 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:47.220921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ac8dc17c-fd7e-4dcc-b71d-d76ecf567cec tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.187425 Oct 17 18:04:47.221606 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 504/981] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:47 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:47.227153 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:47.227973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:47.228695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:47.229510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:47.230050 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:47.230588 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:47.268652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:47.269081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:47.269527 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:47.269990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lazy-loading 'fault' on Instance uuid e979313e-0b00-43f1-ad76-ab5d32f893f2 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:04:47.273484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=100 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:47.320354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f63d32ef14d0597edad54881aa8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69ca9e52e34234ab96b7c753dadfd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:47.329404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-56ad5277-1398-449a-9880-d7b03fc75e71 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 200 len: 1304 microversion: 2.1 time: 0.116464 Oct 17 18:04:47.344677 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 478/982] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:47 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:48.244043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:48.244786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:48.254641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:48.254641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:48.254641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:48.254641 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:48.255011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:48.255011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:48.354721 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:48.355341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] [instance: e979313e-0b00-43f1-ad76-ab5d32f893f2] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:48.361558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:48.362029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:48.362464 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:48.363362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:48.364158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:48.364618 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:48.378623 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] HTTP exception thrown: Instance e979313e-0b00-43f1-ad76-ab5d32f893f2 could not be found. Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Request method failure captured: Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 HTTP/1.1 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZkPp5WjnhS_qGNs69hN-_rxMdG-z9Qzy-cxpYV7cxBGY3woAFSqRqJI63bP1d8L8Mwa7gJCKZjv1Ys0dOwreqT2iSA80J0Z6JK7olt8WH2nXxe92-z6Qx-ErdK6C4G71m0PoEJJHWCJzurmaO8uw8y3jpfFyQg3U-1_KhlogPBCl58 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: ce69ca9e52e34234ab96b7c753dadfd4 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-VolumesActionsTest-771280145 Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:04:48.380307 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce69ca9e52e34234ab96b7c753dadfd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce69ca9e52e34234ab96b7c753dadfd4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce69ca9e52e34234ab96b7c753dadfd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce69ca9e52e34234ab96b7c753dadfd4"}]}] Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-VolumesActionsTest-771280145 Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: ce69ca9e52e34234ab96b7c753dadfd4 Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-VolumesActionsTest-771280145 Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-VolumesActionsTest-771280145-project Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 853f63d32ef14d0597edad54881aa8bb Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-VolumesActionsTest-771280145-project Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance e979313e-0b00-43f1-ad76-ab5d32f893f2 could not be found. Oct 17 18:04:48.382055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': 'e979313e-0b00-43f1-ad76-ab5d32f893f2'} Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e979313e-0b00-43f1-ad76-ab5d32f893f2 could not be found. Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:04:48.382926 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e979313e-0b00-43f1-ad76-ab5d32f893f2 could not be found. Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e979313e-0b00-43f1-ad76-ab5d32f893f2 could not be found. Oct 17 18:04:48.384448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:04:48.385848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] Returning 404 to user: Instance e979313e-0b00-43f1-ad76-ab5d32f893f2 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:04:48.385848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-dce30f76-e54a-4188-a1ca-5e6e5055b836 tempest-VolumesActionsTest-771280145 tempest-VolumesActionsTest-771280145-project] 10.222.0.58 "GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2" status: 404 len: 111 microversion: 2.1 time: 0.031382 Oct 17 18:04:48.385848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 479/983] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:48 2022] GET /compute/v2.1/servers/e979313e-0b00-43f1-ad76-ab5d32f893f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 18:04:48.396002 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:48.406523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7141d226-417f-46e4-94e4-bed96bc9a273 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.166204 Oct 17 18:04:48.407171 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 505/984] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:48 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:48.503310 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-78736f0c-7a4a-4846-90ea-f434a395e9b1 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Action: 'create', calling method: .version_select at 0x7f0199a953a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1553249561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYKxN/VU97/BiePNePJFOzb2darH8NqbwoO69ZfX8OfwdCOFuktI5S//YEGpsGio97lLB7mlyYaSfIbL1p1p0gBikA7HQg3A8yFUuHmSSGX6xW6eGjg2Wy3WmBT2ks8nw=="}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:48.519460 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-78736f0c-7a4a-4846-90ea-f434a395e9b1 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Getting quotas for project dbc61f6f9888420ab54b40ad65d9e689. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:04:48.523416 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-78736f0c-7a4a-4846-90ea-f434a395e9b1 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Getting quotas for user 46c1a45edba44bb5bd0d80822b4c0047 and project dbc61f6f9888420ab54b40ad65d9e689. Resources: {'key_pairs'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:04:48.618120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-78736f0c-7a4a-4846-90ea-f434a395e9b1 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.118795 Oct 17 18:04:48.618721 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 480/985] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 18:04:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:04:48.675459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1737275833", "imageRef": "dd44ddb1-83c9-4225-8b35-d9973fe79e5f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1553249561", "networks": [{"uuid": "4bba1b83-5f47-490c-8fb5-f728e7b11031"}]}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:48.738257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.network.neutron [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] validate_networks() for [('4bba1b83-5f47-490c-8fb5-f728e7b11031', None, None, None, None, None)] {{(pid=126519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:04:49.106061 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-e15fcdb8-ee39-436c-82cf-9f835c6dd884 req-117a1429-115e-4d8a-a362-a29f4a8c1bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd55b7a8-181b-4125-9eeb-ab9d766f8d81", "name": "network-vif-plugged", "status": "completed", "tag": "db33472c-c494-43af-8f07-e9443ae30e6d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:49.119639 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-e15fcdb8-ee39-436c-82cf-9f835c6dd884 req-117a1429-115e-4d8a-a362-a29f4a8c1bb3 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:49.120197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-e15fcdb8-ee39-436c-82cf-9f835c6dd884 req-117a1429-115e-4d8a-a362-a29f4a8c1bb3 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:49.120724 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-e15fcdb8-ee39-436c-82cf-9f835c6dd884 req-117a1429-115e-4d8a-a362-a29f4a8c1bb3 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:49.131952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-e15fcdb8-ee39-436c-82cf-9f835c6dd884 req-117a1429-115e-4d8a-a362-a29f4a8c1bb3 service nova] Creating event network-vif-plugged:db33472c-c494-43af-8f07-e9443ae30e6d for instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 on hv-cinder-86160 Oct 17 18:04:49.137592 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-e15fcdb8-ee39-436c-82cf-9f835c6dd884 req-117a1429-115e-4d8a-a362-a29f4a8c1bb3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035948 Oct 17 18:04:49.138351 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 481/986] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:04:49.168979 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Flavor limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:04:49.169395 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Image limits 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:04:49.169860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Flavor pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:04:49.170259 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Image pref 0:0:0 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:04:49.174070 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.virt.hardware [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:04:49.179359 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:49.179868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:49.180300 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:49.181079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:49.181525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:49.182876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:49.203745 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Getting quotas for project dbc61f6f9888420ab54b40ad65d9e689. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:04:49.208765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Getting quotas for user 46c1a45edba44bb5bd0d80822b4c0047 and project dbc61f6f9888420ab54b40ad65d9e689. Resources: {'cores', 'instances', 'ram'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:04:49.220825 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Going to run 1 instances... {{(pid=126519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:04:49.223355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dd44ddb1-83c9-4225-8b35-d9973fe79e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:04:49.401638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [afa049fc-a32e-4272-ac62-a85958ece3fc] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 18:04:49.449429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:49.450165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:49.456457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:49.456976 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:49.457412 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:49.458106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:49.458583 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:49.463580 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:49.643054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:49.652006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-890f47c6-71f2-4b05-96ee-c6c108d4cc95 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.207736 Oct 17 18:04:49.653463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 482/987] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:49 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:04:50.409257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO oslo.messaging._drivers.impl_rabbit [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [afa049fc-a32e-4272-ac62-a85958ece3fc] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 40788. Oct 17 18:04:50.413440 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-70c4c4e7-7278-4204-b9c0-fded717673ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742000 Oct 17 18:04:50.416642 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 506/988] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:04:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:04:50.426042 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e22aa269-db3d-4479-a43d-68569c5d13a3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:50.426650 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e22aa269-db3d-4479-a43d-68569c5d13a3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:50.481358 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e22aa269-db3d-4479-a43d-68569c5d13a3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:50.488280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e22aa269-db3d-4479-a43d-68569c5d13a3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1259 microversion: 2.1 time: 0.066063 Oct 17 18:04:50.488878 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 483/989] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:50 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:50.675592 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:50.676111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:50.683078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:50.683603 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:50.684184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:50.685052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:50.685502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:50.685919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:50.822588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:50.834761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b59746ed-9f4e-4748-8568-434400ba20af tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.162890 Oct 17 18:04:50.835815 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 507/990] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:50 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:51.511466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:51.513214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:51.520394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:51.520914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:51.521348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:51.522051 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:51.522501 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:51.522931 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:51.590687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:51.598338 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b26b46f0-12ce-4136-b388-a7339209a94e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1263 microversion: 2.1 time: 0.090906 Oct 17 18:04:51.598899 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 484/991] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:51 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:51.859872 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:51.860396 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:51.867317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:51.867777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:51.868209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:51.868928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:51.869379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:51.869798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:52.001631 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:52.009303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a2d9eac2-184d-4d85-8899-79c5e95b8cf2 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.153949 Oct 17 18:04:52.009949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 508/992] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:51 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:52.620894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:52.622261 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:52.628836 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:52.629318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:52.629751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:52.630730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:52.631179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:52.631602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:52.692473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:52.700132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5039075d-70ab-470f-988d-8b973a33fab8 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1263 microversion: 2.1 time: 0.083028 Oct 17 18:04:52.700717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 485/993] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:52 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:53.034463 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:53.035146 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:53.042802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:53.044130 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:53.044724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:53.045898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:53.046344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:53.046770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:53.190265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:53.198624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-21976a6b-901e-4799-9e7d-d48b06f6913f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1266 microversion: 2.1 time: 0.168111 Oct 17 18:04:53.199285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 509/994] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:53 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:53.723037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:53.723632 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:53.730081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:53.730559 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:53.731506 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:53.732202 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:53.732675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:53.738099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:53.801797 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:53.812196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b3985e5a-d359-4f05-a334-ad3f8cc9cf17 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1255 microversion: 2.1 time: 0.092992 Oct 17 18:04:53.812799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 486/995] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:53 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1255 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:54.221973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:54.222582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:54.232110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:54.233056 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:54.233260 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:54.235216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:54.235216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:54.235216 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:54.404969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:54.413669 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e68f93c1-8d28-4a8d-bcde-ec3a1fff94be tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1454 microversion: 2.1 time: 0.195780 Oct 17 18:04:54.414240 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 510/996] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:54 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1454 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:54.439181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:54.439801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:54.447232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:54.447736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:54.448451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:54.449218 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:54.449897 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:54.450327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:54.612582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:54.621940 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-646aed37-23c3-4f8a-a2d7-9a84266b3e1f tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1454 microversion: 2.1 time: 0.188181 Oct 17 18:04:54.622532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 487/997] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:54 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:54.835689 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:54.837400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:54.856607 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:54.861885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:54.862033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:54.867638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:54.868339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:54.868909 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:54.999516 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:55.010309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5ce0c54e-3b3e-438d-8241-ccca8c55499b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1319 microversion: 2.1 time: 0.178652 Oct 17 18:04:55.012207 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 511/998] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:54 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:56.039535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:56.040133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:56.069777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:56.070275 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:56.070716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:56.071447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:56.071977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:56.073890 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:56.300133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:56.310454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3f39c0c9-9ab4-41b7-a185-b7f1a0be6492 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.274811 Oct 17 18:04:56.311381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 488/999] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:56 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:57.337954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:57.339169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:57.354340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:57.354827 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:57.357445 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:57.358161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:57.361163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:57.361823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:57.679671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:57.693278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-14773556-09c4-4f32-8327-f53f8e298e94 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.360823 Oct 17 18:04:57.694788 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 512/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:57 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:04:57.839296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-f588b6e4-7c79-4cbc-8058-9d7f67924864 req-736dc99a-010e-4150-bce6-7a3f4145f38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd55b7a8-181b-4125-9eeb-ab9d766f8d81", "tag": "db33472c-c494-43af-8f07-e9443ae30e6d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:57.878198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f588b6e4-7c79-4cbc-8058-9d7f67924864 req-736dc99a-010e-4150-bce6-7a3f4145f38f service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:57.882410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f588b6e4-7c79-4cbc-8058-9d7f67924864 req-736dc99a-010e-4150-bce6-7a3f4145f38f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:57.892695 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-f588b6e4-7c79-4cbc-8058-9d7f67924864 req-736dc99a-010e-4150-bce6-7a3f4145f38f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:58.015834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-f588b6e4-7c79-4cbc-8058-9d7f67924864 req-736dc99a-010e-4150-bce6-7a3f4145f38f service nova] Creating event network-changed:db33472c-c494-43af-8f07-e9443ae30e6d for instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 on hv-cinder-86160 Oct 17 18:04:58.015834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-f588b6e4-7c79-4cbc-8058-9d7f67924864 req-736dc99a-010e-4150-bce6-7a3f4145f38f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144606 Oct 17 18:04:58.015834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 489/1001] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:04:58.721375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:04:58.722021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:04:58.749249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:58.752289 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:58.763411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:58.763411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:58.763411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:58.763411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:58.836510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-213d33ee-0dff-4bbb-ab81-f8a7cdd5eb6f req-ea253e3b-d607-4669-a4ea-cb7acd7e6ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "tag": "d001871d-63fc-4098-b674-c25e95104541"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:04:58.873004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-213d33ee-0dff-4bbb-ab81-f8a7cdd5eb6f req-ea253e3b-d607-4669-a4ea-cb7acd7e6ec1 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:04:58.879652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-213d33ee-0dff-4bbb-ab81-f8a7cdd5eb6f req-ea253e3b-d607-4669-a4ea-cb7acd7e6ec1 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:04:58.880121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-213d33ee-0dff-4bbb-ab81-f8a7cdd5eb6f req-ea253e3b-d607-4669-a4ea-cb7acd7e6ec1 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:04:58.911657 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-213d33ee-0dff-4bbb-ab81-f8a7cdd5eb6f req-ea253e3b-d607-4669-a4ea-cb7acd7e6ec1 service nova] Creating event network-changed:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:04:58.927413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-213d33ee-0dff-4bbb-ab81-f8a7cdd5eb6f req-ea253e3b-d607-4669-a4ea-cb7acd7e6ec1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094925 Oct 17 18:04:58.929863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 490/1002] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:04:59.191362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:59.215649 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:04:59.572179 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:04:59.585214 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-019e71a5-4338-4ca2-869a-f2032028f64c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.868118 Oct 17 18:04:59.606088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 513/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:04:58 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:00.613452 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:00.614847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:00.618064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:00.629251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:00.633248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:00.633248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:00.633248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:00.633248 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:00.633616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:00.786500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:00.798510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7be70296-553e-4615-b51b-73035ac635cc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.189034 Oct 17 18:05:00.799698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 491/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:00 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:01.828437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:01.830036 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:01.837956 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:01.838866 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:01.839601 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:01.842169 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:01.842901 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:01.843709 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:02.097167 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:02.100969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:02.105946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6385f78f-1b76-4304-b626-718957f0658a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.282739 Oct 17 18:05:02.106578 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 514/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:01 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:03.128226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:03.128883 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:03.143500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:03.145463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:03.146176 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:03.146838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:03.147757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:03.148410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:03.149054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:03.370266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:03.374901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ee5c9d0d-fd7f-4d77-bbae-4ac7ece6e534 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.250403 Oct 17 18:05:03.389586 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 492/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:03 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:04.399942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:04.405596 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:04.416920 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:04.418435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:04.419459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:04.422402 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:04.423404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:04.424077 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:04.671064 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:04.686576 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-62be44df-29d4-4667-b77c-6e5504890a0a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.290496 Oct 17 18:05:04.688344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 515/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:04 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:05.715380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:05.716023 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:05.726280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:05.726787 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:05.727255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:05.733837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:05.734381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:05.734862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:05.919577 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:05.934394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d9046cc6-a87d-470c-ae44-7326d6afd48c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.223323 Oct 17 18:05:05.935497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 493/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:05 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:06.999785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:07.000449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:07.002309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:07.007503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:07.008349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:07.009059 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:07.010021 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:07.010710 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:07.025052 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:07.212867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:07.223642 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-587e9f82-42d2-4e2d-8d9a-b641e4a7d3a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.264946 Oct 17 18:05:07.224230 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 516/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:06 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:08.248197 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:08.248951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:08.257025 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:08.257702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:08.258214 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:08.258912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:08.259528 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:08.260054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:08.401244 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:08.411106 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-24a65c25-26d5-462a-9f94-4b559558b518 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.167349 Oct 17 18:05:08.425491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 494/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:08 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:09.439412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:09.440206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:09.448550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:09.449828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:09.450394 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:09.451339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:09.452019 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:09.452836 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:09.612573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:09.628583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-323aa1b8-115e-401a-a6ce-d7cbe8dee370 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.193810 Oct 17 18:05:09.644442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 517/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:09 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:10.655148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:10.656065 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:10.664668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:10.665149 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:10.665586 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:10.666405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:10.666862 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:10.667285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:10.826383 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:10.834711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a3a015d3-414a-4ac7-b180-aaf531c94bf2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.186728 Oct 17 18:05:10.835302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 495/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:10 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:11.859609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:11.860249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:11.874094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:11.874094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:11.874094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:11.874094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:11.874573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:11.874573 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:12.001693 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:12.009550 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c6a19209-efb1-4a33-942d-e63c2f43c5a6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.154393 Oct 17 18:05:12.010345 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 518/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:11 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:13.035547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:13.036395 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:13.043507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:13.043891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:13.044008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:13.044907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:13.045674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:13.045985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:13.150850 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-d6a2cf53-599b-42e0-9376-6157142df91d req-b08fbbda-ea78-40d5-bbd5-5eb932934561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "name": "network-vif-plugged", "status": "completed", "tag": "d001871d-63fc-4098-b674-c25e95104541"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:13.157761 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d6a2cf53-599b-42e0-9376-6157142df91d req-b08fbbda-ea78-40d5-bbd5-5eb932934561 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:13.158459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d6a2cf53-599b-42e0-9376-6157142df91d req-b08fbbda-ea78-40d5-bbd5-5eb932934561 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:13.158944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d6a2cf53-599b-42e0-9376-6157142df91d req-b08fbbda-ea78-40d5-bbd5-5eb932934561 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:13.171808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-d6a2cf53-599b-42e0-9376-6157142df91d req-b08fbbda-ea78-40d5-bbd5-5eb932934561 service nova] Creating event network-vif-plugged:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:05:13.177439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-d6a2cf53-599b-42e0-9376-6157142df91d req-b08fbbda-ea78-40d5-bbd5-5eb932934561 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036166 Oct 17 18:05:13.178442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 519/1014] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:05:13.207027 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:13.214777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-64c0169a-06ae-430a-a5bb-388255b7cbeb tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.183413 Oct 17 18:05:13.216001 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 496/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:13 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:14.239073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:14.239786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:14.246489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:14.247084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:14.247509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:14.248193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:14.248699 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:14.249114 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:14.387099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:14.394896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-487a3279-cabc-4859-bde1-faaeaf703b4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1359 microversion: 2.1 time: 0.160199 Oct 17 18:05:14.395455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 520/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:14 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:15.419203 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:15.419841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:15.426272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.426763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.427200 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.427892 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.428344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.428797 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.559004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:15.566599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-95de510a-e325-457f-bf80-27f21d715559 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1549 microversion: 2.1 time: 0.151943 Oct 17 18:05:15.567169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 497/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:15 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:15.588749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:15.589349 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:15.596282 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.596823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.597254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.597929 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.598372 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.598823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.729781 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:15.738222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-96c672f4-b0ba-4ecf-a096-13fcb6f1e483 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1549 microversion: 2.1 time: 0.153285 Oct 17 18:05:15.738798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 521/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:15 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:15.762454 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:15.766083 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:15.766857 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Searching by: {'deleted': False, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689'} {{(pid=126522) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 18:05:15.773708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.774194 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.774634 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.775364 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.775815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.776242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.868829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.multi_cell_list [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126522) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 18:05:15.970949 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7e6da599-1e9a-4c85-b498-cfb78fcb529e tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214225 Oct 17 18:05:15.971552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 498/1019] 10.222.0.58 () {58 vars in 1125 bytes} [Mon Oct 17 18:05:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:15.984054 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:15.984702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:15.990701 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.991404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.992015 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:15.992967 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:15.993425 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:15.993849 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:16.218268 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:16.225976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6b5accda-87a6-415f-aeed-c8fe12731697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1549 microversion: 2.1 time: 0.246654 Oct 17 18:05:16.226640 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 522/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:15 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1549 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:17.480035 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:17.483052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:17.489394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:17.489876 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:17.490312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:17.491005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:17.491491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:17.491915 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:17.495663 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=97 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:17.522028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8d2a7dd8-8a27-46ab-9ba1-9502634886dc tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045958 Oct 17 18:05:17.522602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 499/1021] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:05:17 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:05:17.588115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:17.588695 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:17.595401 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:17.597238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:17.597238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:17.597238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:17.597538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:17.597885 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:17.626103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:05:17.987036 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c85f792c-34a8-4945-9ae1-622226676f19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 204 len: 0 microversion: 2.1 time: 0.402476 Oct 17 18:05:17.987625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 523/1022] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:05:17 2022] DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:05:17.996417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:17.997090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:18.003575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:18.004056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:18.004494 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:18.005223 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:18.005680 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:18.006107 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:18.150481 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:18.160098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bdae501a-de23-4bc7-a072-6544ce9ce5a9 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1673 microversion: 2.1 time: 0.167961 Oct 17 18:05:18.160922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 500/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:17 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:18.336131 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:18.338588 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:18.345281 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:18.346981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:18.346981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:18.346981 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:18.347454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:18.347667 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:19.183886 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:19.184428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:19.190894 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:19.191371 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:19.191798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:19.192517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:19.192988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:19.193407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:19.320919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:19.328829 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d927b3c5-bf5b-4c3b-80c8-03d2bb17c34d tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1673 microversion: 2.1 time: 0.149295 Oct 17 18:05:19.329448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 501/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:19 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:05:20.355673 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:20.358213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:20.366263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:20.367132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:20.367786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:20.368744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:20.369417 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:20.370059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:20.622702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:20.623151 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-47595fd7-974c-4424-ae3f-171e2dca5113 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.289894 Oct 17 18:05:20.624369 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 524/1025] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:05:18 2022] POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments => generated 194 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:20.642725 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-65c4a5ae-4203-4435-9613-35cfa7d0251e tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1673 microversion: 2.1 time: 0.291078 Oct 17 18:05:20.647869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 502/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:20 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1673 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:05:21.162632 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-d03edabb-7ff6-4473-a297-e19f6654db9c req-8f3b0bec-31e2-4fa9-8eb2-b29ba6c1694f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906", "name": "network-vif-deleted", "tag": "92c42fda-d155-49ee-931b-54fa435e7c51"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:21.173896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d03edabb-7ff6-4473-a297-e19f6654db9c req-8f3b0bec-31e2-4fa9-8eb2-b29ba6c1694f service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:21.174355 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d03edabb-7ff6-4473-a297-e19f6654db9c req-8f3b0bec-31e2-4fa9-8eb2-b29ba6c1694f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:21.174808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-d03edabb-7ff6-4473-a297-e19f6654db9c req-8f3b0bec-31e2-4fa9-8eb2-b29ba6c1694f service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:21.185706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-d03edabb-7ff6-4473-a297-e19f6654db9c req-8f3b0bec-31e2-4fa9-8eb2-b29ba6c1694f service nova] Creating event network-vif-deleted:92c42fda-d155-49ee-931b-54fa435e7c51 for instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 on hv-cinder-86160 Oct 17 18:05:21.190503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-d03edabb-7ff6-4473-a297-e19f6654db9c req-8f3b0bec-31e2-4fa9-8eb2-b29ba6c1694f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032085 Oct 17 18:05:21.191106 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 525/1027] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:21.665124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:21.665819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:21.673838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:21.674555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:21.674968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:21.675934 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:21.676428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:21.677724 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:21.721906 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:21.722513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:21.723047 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:21.723552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lazy-loading 'fault' on Instance uuid ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:05:21.771372 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:21.780549 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d4e5357c-f6aa-4e97-8f1c-616a2cd4ee7c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 200 len: 1326 microversion: 2.1 time: 0.119310 Oct 17 18:05:21.783384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 503/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:21 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:22.805399 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:22.806092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:22.812583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:22.813118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:22.813556 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:22.814248 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:22.814703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:22.815125 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:22.828879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] HTTP exception thrown: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Request method failure captured: Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 HTTP/1.1 Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZij0S__pAMI8a1Jc-fLdfJi4FLIs6G0_NG7LbCmZYlOgNevnZW_51bVZqk1R_dRCIYiMk_f3Mtw9_Z_i5Na6hGLT88oW9fUORWzDE_m-V-YBzpk1p7jyY0fBLSvXide-rfgo9fivDej9M6EBELHEYvLPut5uLYU0Ly9-B_WipiAt8k Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:05:22.830488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d7fb8ced44d4a4fb84e3fd806c436d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}] Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: b77324aa35534726b030564b5b70fb22 Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:05:22.832263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906'} Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:05:22.833320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:05:22.834975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:05:22.836456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Returning 404 to user: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:05:22.836456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-46c71d08-f66e-48e8-81e0-b65d0fc72e97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 404 len: 111 microversion: 2.1 time: 0.031239 Oct 17 18:05:22.836456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 526/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:22 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:05:22.846995 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-41eb4035-dbb0-4dbc-95ef-56a3192f68fa tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '.version_select at 0x7f0196232160>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:22.944283 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-41eb4035-dbb0-4dbc-95ef-56a3192f68fa tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172755316" status: 202 len: 0 microversion: 2.1 time: 0.101149 Oct 17 18:05:22.945010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 504/1030] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 17 18:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172755316 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:05:23.700187 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0f7876d3-f00c-4b5b-85e7-b548361bba9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: .version_select at 0x7f0196142ee0>, body: {"keypair": {"name": "tempest-keypair-1398104804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkkwk+euXGUX3k5NpSYz4sQKy86wTL1w3fkE1ZuXPOzq3qjwzfOB8siBRtYwtEYMQDbEl8WnTpdde096G1uXrYCVNZovfMPMlQIIna2jm/xIQy6KtEwe9YLnC26KOWCQQ=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:23.715893 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-0f7876d3-f00c-4b5b-85e7-b548361bba9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:05:23.719677 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-0f7876d3-f00c-4b5b-85e7-b548361bba9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for user b77324aa35534726b030564b5b70fb22 and project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:05:23.732229 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f7876d3-f00c-4b5b-85e7-b548361bba9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [ea2dcf75-167a-449d-b4e0-1de86d43871e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 18:05:24.740246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f7876d3-f00c-4b5b-85e7-b548361bba9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [ea2dcf75-167a-449d-b4e0-1de86d43871e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41196. Oct 17 18:05:24.839920 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0f7876d3-f00c-4b5b-85e7-b548361bba9f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.143459 Oct 17 18:05:24.840547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 527/1031] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 18:05:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:27.361622 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:27.366134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1295160608", "imageRef": "288f461f-dd25-4904-894a-1f3298b4d82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e8887de-6e79-4183-8b8b-78a219ef29bb"}], "security_groups": [{"name": "tempest-securitygroup--476937667"}], "key_name": "tempest-keypair-1398104804", "user_data": "}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:27.470308 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] validate_networks() for [('3e8887de-6e79-4183-8b8b-78a219ef29bb', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:05:27.835753 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:05:27.836179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:05:27.836685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:05:27.837097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:05:27.837509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:05:27.846856 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:27.847341 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:27.847780 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:27.848512 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:27.849003 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:27.849428 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:27.867484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:05:27.873113 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Getting quotas for user b77324aa35534726b030564b5b70fb22 and project 4d7fb8ced44d4a4fb84e3fd806c436d6. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:05:27.883056 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:05:27.885429 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='288f461f-dd25-4904-894a-1f3298b4d82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:05:28.002179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-52616fb9-9133-49b2-8398-0f9ccd211b99 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641737 Oct 17 18:05:28.002745 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 505/1032] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:05:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:05:28.015246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-63fdab2c-58de-48ca-932d-25fdbb884fc1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:28.015856 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-63fdab2c-58de-48ca-932d-25fdbb884fc1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:28.077129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-63fdab2c-58de-48ca-932d-25fdbb884fc1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:28.084740 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-63fdab2c-58de-48ca-932d-25fdbb884fc1 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1238 microversion: 2.1 time: 0.074424 Oct 17 18:05:28.090358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 528/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:28 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:29.109380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:29.109997 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:29.115901 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:29.116379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:29.116851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:29.117547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:29.118085 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:29.118415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:29.188517 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:29.196147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5c3de5c6-f222-478d-9731-ebc899daf6d2 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1242 microversion: 2.1 time: 0.092038 Oct 17 18:05:29.196737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 506/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:29 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:30.220463 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:30.221136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:30.227818 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:30.228313 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:30.228779 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:30.229480 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:30.230096 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:30.230525 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:30.295545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:30.303800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-015c7670-0f3b-4de5-8a53-2d8c1099b36c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1242 microversion: 2.1 time: 0.088757 Oct 17 18:05:30.304383 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 529/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:30 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:31.331110 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:31.332093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:31.338993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:31.339575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:31.340105 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:31.340929 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:31.342189 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:31.342705 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:31.416624 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:31.425414 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-84173f11-31ed-44cd-b64b-41783342959b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1290 microversion: 2.1 time: 0.098412 Oct 17 18:05:31.426002 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 507/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:31 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:31.436483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:31.437125 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:31.443862 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:31.444420 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:31.444905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:31.450760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:31.450760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:31.450760 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:31.579764 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:31.588278 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f08795ac-9d9a-4a70-9fea-1ce76cd1b820 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1595 microversion: 2.1 time: 0.155569 Oct 17 18:05:31.588884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 530/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:31 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:32.449118 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:32.449754 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:32.457989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:32.458773 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:32.459202 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:32.460159 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:32.460850 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:32.461448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:32.663274 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:32.672285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9c07d2fc-1260-43c2-ac62-50bafb2e44af tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1296 microversion: 2.1 time: 0.227442 Oct 17 18:05:32.674596 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 508/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:32 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:33.696896 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:33.697512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:33.704901 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:33.705679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:33.706309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:33.707022 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:33.707576 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:33.708011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:33.830560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-7abcc4a5-3a02-42f7-8b26-4768a0a6aced req-1dc7349e-c089-4999-a903-a22b9c28ec08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "tag": "d001871d-63fc-4098-b674-c25e95104541"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:33.840095 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:33.842158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7abcc4a5-3a02-42f7-8b26-4768a0a6aced req-1dc7349e-c089-4999-a903-a22b9c28ec08 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:33.842627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7abcc4a5-3a02-42f7-8b26-4768a0a6aced req-1dc7349e-c089-4999-a903-a22b9c28ec08 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:33.843216 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-7abcc4a5-3a02-42f7-8b26-4768a0a6aced req-1dc7349e-c089-4999-a903-a22b9c28ec08 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:33.857288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-7abcc4a5-3a02-42f7-8b26-4768a0a6aced req-1dc7349e-c089-4999-a903-a22b9c28ec08 service nova] Creating event network-changed:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:05:33.869240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-7abcc4a5-3a02-42f7-8b26-4768a0a6aced req-1dc7349e-c089-4999-a903-a22b9c28ec08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042387 Oct 17 18:05:33.869769 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 509/1039] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:33.904162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:33.913242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ed5bdf59-c9de-4698-82ce-f72cbfe6e52b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.220209 Oct 17 18:05:33.914448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 531/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:33 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:33.987438 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-25f7d7d3-8b08-4996-94f1-ba8ab393bcd2 req-bd625e48-0799-453e-84b4-a19ae4df2604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583d5cc9-1197-4c23-8e44-9f707ab0e73d", "tag": "aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:34.016490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-25f7d7d3-8b08-4996-94f1-ba8ab393bcd2 req-bd625e48-0799-453e-84b4-a19ae4df2604 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:34.017863 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-25f7d7d3-8b08-4996-94f1-ba8ab393bcd2 req-bd625e48-0799-453e-84b4-a19ae4df2604 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:34.019069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-25f7d7d3-8b08-4996-94f1-ba8ab393bcd2 req-bd625e48-0799-453e-84b4-a19ae4df2604 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:34.032851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-25f7d7d3-8b08-4996-94f1-ba8ab393bcd2 req-bd625e48-0799-453e-84b4-a19ae4df2604 service nova] Creating event network-changed:aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e for instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d on hv-cinder-86160 Oct 17 18:05:34.037685 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-25f7d7d3-8b08-4996-94f1-ba8ab393bcd2 req-bd625e48-0799-453e-84b4-a19ae4df2604 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065228 Oct 17 18:05:34.038295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 510/1041] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:34.939657 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:34.940099 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:34.953370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:34.955412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:34.955985 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:34.957085 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:34.957655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:34.958183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:34.979302 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:35.179044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:35.187730 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e61a7d94-34ae-415c-8410-c96e10c77d97 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.254675 Oct 17 18:05:35.188310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 532/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:34 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:36.211632 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:36.212404 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:36.220625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.221324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.221764 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.222470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.222939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.223370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.357782 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:36.360283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-995795517"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:36.360851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:36.366538 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-3a8fcb41-ba30-4fcc-adfe-3c2953f4bb19 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.159537 Oct 17 18:05:36.371941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 511/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:36 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:36.372385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.372385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.372385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.372385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.373520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.373520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.504320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.network.security_group_api [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Adding security group 92c98802-608e-4b37-a2f8-7223fac4f756 to port d001871d-63fc-4098-b674-c25e95104541 Oct 17 18:05:36.870398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-608dd6d2-c591-4ebf-9319-82553bf24b1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/action" status: 202 len: 0 microversion: 2.1 time: 0.514978 Oct 17 18:05:36.871044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 533/1044] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:05:36 2022] POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 18:05:36.882028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:36.883164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:36.884822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-fa9362a5-061f-49ad-8c18-b3c104eefd42 req-53ab65d2-c8be-4121-b531-1083e5f7617d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "tag": "d001871d-63fc-4098-b674-c25e95104541"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:36.894629 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-fa9362a5-061f-49ad-8c18-b3c104eefd42 req-53ab65d2-c8be-4121-b531-1083e5f7617d service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.895115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-fa9362a5-061f-49ad-8c18-b3c104eefd42 req-53ab65d2-c8be-4121-b531-1083e5f7617d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.895538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-fa9362a5-061f-49ad-8c18-b3c104eefd42 req-53ab65d2-c8be-4121-b531-1083e5f7617d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.903597 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.905028 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.907039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.907242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-fa9362a5-061f-49ad-8c18-b3c104eefd42 req-53ab65d2-c8be-4121-b531-1083e5f7617d service nova] Creating event network-changed:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:05:36.908211 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:36.912296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-fa9362a5-061f-49ad-8c18-b3c104eefd42 req-53ab65d2-c8be-4121-b531-1083e5f7617d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033220 Oct 17 18:05:36.912458 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:36.912969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:36.913377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 534/1045] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:37.185422 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:37.196961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c41a4394-5795-4558-ad5d-a5db18634b00 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1759 microversion: 2.1 time: 0.320690 Oct 17 18:05:37.197757 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 512/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:36 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1759 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:05:37.395756 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:37.397666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:37.409808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:37.411166 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:37.411643 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:37.413024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:37.413603 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:37.414297 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:37.651084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:37.665079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-4f498664-5c4d-4395-aba9-b31fa5379749 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.275614 Oct 17 18:05:37.665775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 535/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:37 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:38.689789 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:38.690512 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:38.693129 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:38.693865 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=6 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:38.699613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:38.700170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:38.701267 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:38.702205 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:38.702730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:38.703193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:38.840796 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:38.848826 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a8e90f90-8b80-4920-ab66-2a9a2e1f55d4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.163920 Oct 17 18:05:38.851922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 513/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:38 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:39.871409 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:39.872043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:39.875912 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=6 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:39.882569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:39.883385 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:39.883876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:39.884310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:39.885051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:39.885503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:39.885926 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:40.020976 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:40.030168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c23824d3-de2f-48c6-a959-a8bcfbcf9767 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.162350 Oct 17 18:05:40.030848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 536/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:39 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:41.052356 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:41.052995 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:41.059659 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:41.060136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:41.060689 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:41.061427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:41.061877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:41.062302 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:41.199930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:41.209841 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-79b8b371-1dbc-4c34-8b7e-00dee554e030 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.161392 Oct 17 18:05:41.210413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 514/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:41 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:41.354209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-5d2b9c65-cbee-4e30-b9e0-c68c67e73a13 req-a1ede408-6c3e-4f8c-b0ec-43856c634a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583d5cc9-1197-4c23-8e44-9f707ab0e73d", "name": "network-vif-plugged", "status": "completed", "tag": "aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:41.365362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-5d2b9c65-cbee-4e30-b9e0-c68c67e73a13 req-a1ede408-6c3e-4f8c-b0ec-43856c634a90 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:41.365833 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-5d2b9c65-cbee-4e30-b9e0-c68c67e73a13 req-a1ede408-6c3e-4f8c-b0ec-43856c634a90 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:41.366251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-5d2b9c65-cbee-4e30-b9e0-c68c67e73a13 req-a1ede408-6c3e-4f8c-b0ec-43856c634a90 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:41.377920 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-5d2b9c65-cbee-4e30-b9e0-c68c67e73a13 req-a1ede408-6c3e-4f8c-b0ec-43856c634a90 service nova] Creating event network-vif-plugged:aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e for instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d on hv-cinder-86160 Oct 17 18:05:41.382770 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-5d2b9c65-cbee-4e30-b9e0-c68c67e73a13 req-a1ede408-6c3e-4f8c-b0ec-43856c634a90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Oct 17 18:05:41.383336 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 537/1051] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:42.235026 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:42.235746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:42.242380 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:42.242869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:42.243308 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:42.244013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:42.244475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:42.244933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:42.381511 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:42.389328 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7f28d648-fbf0-4aab-9f4c-13e156b7e25b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.159612 Oct 17 18:05:42.389891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 515/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:42 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:43.413927 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:43.414619 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:43.421975 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:43.422513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:43.422972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:43.423654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:43.424103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:43.424530 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:43.562464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:43.570012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-40dc9184-8ab2-4784-a9a2-cc42b1353d9a tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1363 microversion: 2.1 time: 0.160908 Oct 17 18:05:43.570579 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 538/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:43 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:44.593830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:44.594385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:44.600825 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:44.601299 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:44.601727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:44.602403 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:44.602845 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:44.603312 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:44.735957 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:44.743562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bae6c486-c098-4378-b355-cecc867b4318 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1548 microversion: 2.1 time: 0.154253 Oct 17 18:05:44.744124 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 516/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:44 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:44.766418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:44.767586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:44.774479 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:44.774973 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:44.775476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:44.776215 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:44.776987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:44.777466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:44.858915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8266983e-7823-4147-bb09-e4eb758be3b4 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096393 Oct 17 18:05:44.859527 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 539/1055] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 17 18:05:44 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:05:46.143406 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-15901628-ece6-4891-9b8c-6a0b15d33cdf req-aea07982-9862-4585-81b8-8a410aae8eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583d5cc9-1197-4c23-8e44-9f707ab0e73d", "tag": "aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:46.153290 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-15901628-ece6-4891-9b8c-6a0b15d33cdf req-aea07982-9862-4585-81b8-8a410aae8eb8 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:46.153767 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-15901628-ece6-4891-9b8c-6a0b15d33cdf req-aea07982-9862-4585-81b8-8a410aae8eb8 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:46.154405 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-15901628-ece6-4891-9b8c-6a0b15d33cdf req-aea07982-9862-4585-81b8-8a410aae8eb8 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:46.166908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-15901628-ece6-4891-9b8c-6a0b15d33cdf req-aea07982-9862-4585-81b8-8a410aae8eb8 service nova] Creating event network-changed:aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e for instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d on hv-cinder-86160 Oct 17 18:05:46.173753 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-15901628-ece6-4891-9b8c-6a0b15d33cdf req-aea07982-9862-4585-81b8-8a410aae8eb8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033220 Oct 17 18:05:46.174775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 517/1056] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:05:56.530844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=7 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:56.531612 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=32 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:56.536630 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:05:56.538806 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:56.544436 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:56.544949 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:56.545373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:56.546098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:56.546541 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:56.546954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:56.761520 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e86ed5b8-ce2c-4a4d-9f71-e2eee3a27ead tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/action" status: 202 len: 0 microversion: 2.1 time: 0.231885 Oct 17 18:05:56.762193 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 540/1057] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:05:56 2022] POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 18:05:56.771741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:56.772448 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:56.775507 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=17 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:56.776249 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=93 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:05:56.781353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:56.781842 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:56.782311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:56.783390 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:56.784370 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:56.784830 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:56.932355 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:56.940535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-c93265c3-d708-49f8-a9d5-71b26b418bcc tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1751 microversion: 2.1 time: 0.173930 Oct 17 18:05:56.941144 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 518/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:56 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:05:57.966532 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:57.967238 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:57.973998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:57.974472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:57.974900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:57.975580 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:57.976025 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:57.976438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:58.119589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:58.127948 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-9b6d58ca-5d16-4933-8dd7-e7221ca5d0e0 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.166073 Oct 17 18:05:58.128513 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 541/1059] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:57 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:05:59.151360 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:05:59.151990 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:05:59.160090 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:59.160570 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:59.161111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:59.161802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:05:59.162253 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:05:59.162675 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:05:59.319141 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:05:59.327603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e2478fb6-c59f-42fd-9cf0-4e8b3084c0ca tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.180209 Oct 17 18:05:59.328279 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 519/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:05:59 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:00.351076 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:00.351679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:00.358091 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:00.358571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:00.359001 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:00.359690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:00.360138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:00.360563 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:00.511186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:00.520341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-eabe4e1d-e6fc-47df-9e95-11fa7c8d6697 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.173128 Oct 17 18:06:00.520989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 542/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:00 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:01.543614 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:01.544165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:01.552041 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:01.552516 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:01.552970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:01.553681 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:01.554131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:01.554551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:01.695929 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:01.704068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-7e815327-26a7-47dd-b356-5c3d19e940e3 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.164665 Oct 17 18:06:01.704691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 520/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:01 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:02.726840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:02.727437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:02.733971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:02.734442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:02.734866 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:02.735545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:02.736608 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:02.737114 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:02.888699 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:02.898379 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-793b2ad4-4c76-4e12-87f8-ba451477c497 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.175413 Oct 17 18:06:02.898946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 543/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:02 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:03.922587 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:03.923742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:03.931178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:03.931676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:03.932379 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:03.933108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:03.933742 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:03.934169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:04.084362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:04.092668 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f2f6299f-db91-4243-9844-f3d21f160ad4 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.174042 Oct 17 18:06:04.093244 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 521/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:03 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:05.116512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:05.117206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:05.123533 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:05.124001 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:05.124424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:05.125124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:05.125567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:05.125988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:05.271125 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:05.279322 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-135e828f-ab38-47de-a1c9-6f37f7bfb548 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.167129 Oct 17 18:06:05.279878 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 544/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:05 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:06.302667 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:06.304512 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:06.311228 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:06.311715 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:06.312156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:06.312883 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:06.313344 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:06.313775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:06.662225 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:06.670459 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-600ddd4c-807d-47c5-90b3-b875a24fcc43 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.372625 Oct 17 18:06:06.671037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 522/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:06 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:07.695547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:07.696069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:07.702542 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:07.703075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:07.703510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:07.704189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:07.704659 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:07.705662 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:07.913159 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:07.921534 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-47e36656-999c-493b-81fd-4c164c3a15ea tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.229893 Oct 17 18:06:07.922100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 545/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:07 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:08.951330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:08.951941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:08.958917 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:08.959393 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:08.959828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:08.960552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:08.961023 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:08.961445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:09.115095 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:09.123598 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e7e2b582-9458-4bcb-bd46-de9e491cb320 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.176175 Oct 17 18:06:09.124174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 523/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:08 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:10.147407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:10.147933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:10.154398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:10.154879 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:10.155305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:10.155988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:10.156518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:10.156962 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:10.304308 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:10.311134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b35e77bb-b8bb-4b7a-89b4-a8a749232910 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.167634 Oct 17 18:06:10.311676 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 546/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:10 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:11.335941 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:11.336547 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:11.342909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:11.343391 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:11.343823 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:11.344508 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:11.345805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:11.345805 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:11.494470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:11.504031 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b31262bb-fda1-48cb-84ae-8c269bfe49c2 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.172005 Oct 17 18:06:11.504619 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 524/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:11 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:12.527341 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:12.527955 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:12.535145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:12.535627 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:12.536177 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:12.536826 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:12.537280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:12.537702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:12.679637 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:12.688474 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-404eb497-26d8-4cf5-8ef3-ba58e8c66f05 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.165082 Oct 17 18:06:12.689084 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 547/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:12 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:13.712284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:13.712952 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:13.719147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:13.719628 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:13.720063 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:13.720792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:13.721838 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:13.722168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:13.864235 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:13.872585 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-e730ea15-1b58-4c08-9732-9b749d2f4214 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.164193 Oct 17 18:06:13.875486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 525/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:13 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:14.896915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:14.897549 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:14.903993 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:14.904459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:14.904918 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:14.905600 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:14.906049 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:14.906472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:15.047003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:15.055316 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e13468ac-7566-4cd5-950b-3aebae5d9d39 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.163133 Oct 17 18:06:15.055887 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 548/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:14 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:16.079202 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:16.079787 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:16.086821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:16.087296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:16.087727 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:16.088407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:16.088885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:16.089305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:16.232483 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:16.241387 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9538bd39-d575-44f6-9b54-ef73082fe202 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.166021 Oct 17 18:06:16.241954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 526/1074] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:16 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:17.265671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:17.266257 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:17.273381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:17.273855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:17.274288 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:17.274972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:17.275423 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:17.275844 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:17.420344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:17.428892 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-3600767b-c7ce-4806-8717-9a75c3a76f4a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.167131 Oct 17 18:06:17.429523 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 549/1075] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:17 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:18.453297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:18.453884 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:18.460233 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:18.460738 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:18.461172 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:18.461847 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:18.462294 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:18.462741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:18.606920 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:18.617069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ac0d62e0-a572-43cc-9544-d4d0cacb6f96 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1756 microversion: 2.1 time: 0.167632 Oct 17 18:06:18.624216 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 527/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:18 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:19.641387 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:19.642024 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:19.649263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:19.649749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:19.650211 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:19.650863 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:19.651319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:19.651744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:19.791997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:19.801209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-881462fe-8c17-4f29-8880-4c039a5e470d tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1759 microversion: 2.1 time: 0.163653 Oct 17 18:06:19.801786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 550/1077] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:19 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:22.010602 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:22.011148 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:22.017843 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:22.019162 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:22.019366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:22.020055 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:22.020510 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:22.020963 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:22.044111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bc96f8db-755b-4396-b638-013388cdc809 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/ips" status: 200 len: 145 microversion: 2.1 time: 0.037418 Oct 17 18:06:22.044718 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 528/1078] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 17 18:06:22 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:23.605732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c610af-3033-4abf-a98b-d70d5d8c4edf"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:23.608134 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:23.615242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:23.615717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:23.616173 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:23.616884 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:23.617327 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:23.617746 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:24.303398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2f74b923-200d-44d8-9ec3-b3281c0872ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700959 Oct 17 18:06:24.304026 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 551/1079] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:06:23 2022] POST /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:31.835993 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:31.838281 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:31.840627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=23 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:06:31.845394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:31.848914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:31.848914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:31.848914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:31.848914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:31.849322 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:31.850741 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=65 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:06:31.879145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f9a560ec-327e-48b3-9fac-581aa6549532 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Oct 17 18:06:31.879716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 529/1080] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:31 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:31.894069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:31.900988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:31.900988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=25 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:06:31.902035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:31.902506 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:31.902936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:31.903616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:31.904065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:31.904479 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:31.906835 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:06:31.935276 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c8a4e4b6-6b90-484c-a659-0e51a855fc20 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/a8c610af-3033-4abf-a98b-d70d5d8c4edf" status: 200 len: 194 microversion: 2.1 time: 0.046197 Oct 17 18:06:31.935868 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 552/1081] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Oct 17 18:06:31 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/a8c610af-3033-4abf-a98b-d70d5d8c4edf => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:06:33.535427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "840a6ba8-bbb4-4092-a003-82f94ac9dbd7"}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:33.537763 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:33.545456 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:33.545940 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:33.546378 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:33.547068 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:33.547523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:33.547951 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:34.260236 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-23f1fd46-ef7a-4a5c-ad71-c615fb65d242 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "POST /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728496 Oct 17 18:06:34.260885 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 530/1082] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 17 18:06:33 2022] POST /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:38.802896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-23a6fa93-6efb-4ed5-a283-f626cf898f02 req-5f5d315c-4882-497c-b70c-386fb627007b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd55b7a8-181b-4125-9eeb-ab9d766f8d81", "tag": "db33472c-c494-43af-8f07-e9443ae30e6d"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:38.808198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:38.810536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:38.813571 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-23a6fa93-6efb-4ed5-a283-f626cf898f02 req-5f5d315c-4882-497c-b70c-386fb627007b service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:38.814071 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-23a6fa93-6efb-4ed5-a283-f626cf898f02 req-5f5d315c-4882-497c-b70c-386fb627007b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:38.814514 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-23a6fa93-6efb-4ed5-a283-f626cf898f02 req-5f5d315c-4882-497c-b70c-386fb627007b service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:38.816922 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:38.817339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:38.817763 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:38.818585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:38.819035 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:38.820296 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:38.826535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-23a6fa93-6efb-4ed5-a283-f626cf898f02 req-5f5d315c-4882-497c-b70c-386fb627007b service nova] Creating event network-changed:db33472c-c494-43af-8f07-e9443ae30e6d for instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 on hv-cinder-86160 Oct 17 18:06:38.831572 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-23a6fa93-6efb-4ed5-a283-f626cf898f02 req-5f5d315c-4882-497c-b70c-386fb627007b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033115 Oct 17 18:06:38.832179 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 531/1083] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:38.852412 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:06:39.193403 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2ba1477d-43ca-4ebd-9907-08aacb28097e tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 204 len: 0 microversion: 2.1 time: 0.396815 Oct 17 18:06:39.194012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 553/1084] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:06:38 2022] DELETE /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:06:39.207604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:39.207604 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:39.211169 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:39.211651 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:39.212085 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:39.212938 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:39.213532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:39.214146 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:39.395837 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:39.404936 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fc68ce2b-8874-4f68-982e-3147eb5f02ce tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1578 microversion: 2.1 time: 0.205617 Oct 17 18:06:39.405601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 532/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:39 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:40.429045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:40.430232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:40.437056 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:40.437526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:40.437953 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:40.438633 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:40.439079 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:40.439500 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:40.574201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:40.581851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fde05e9b-0833-4dbc-adb1-634bfef7121b tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1578 microversion: 2.1 time: 0.157212 Oct 17 18:06:40.582426 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 554/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:40 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:41.605586 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:41.606193 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:41.612495 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:41.613004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:41.613437 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:41.614121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:41.614572 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:41.614991 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:41.751242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:41.759692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-313c960c-1b82-4394-839a-4d0f77dee662 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1460 microversion: 2.1 time: 0.157978 Oct 17 18:06:41.760258 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 533/1087] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:41 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1460 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:42.484320 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-28e7b0d9-d950-48c3-a985-53f7da0b4e8f req-f9c1afea-f6be-4f9f-b4b1-7d8ee9aae5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd55b7a8-181b-4125-9eeb-ab9d766f8d81", "name": "network-vif-deleted", "tag": "db33472c-c494-43af-8f07-e9443ae30e6d"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:42.495438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-28e7b0d9-d950-48c3-a985-53f7da0b4e8f req-f9c1afea-f6be-4f9f-b4b1-7d8ee9aae5bc service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:42.495931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-28e7b0d9-d950-48c3-a985-53f7da0b4e8f req-f9c1afea-f6be-4f9f-b4b1-7d8ee9aae5bc service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:42.496473 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-28e7b0d9-d950-48c3-a985-53f7da0b4e8f req-f9c1afea-f6be-4f9f-b4b1-7d8ee9aae5bc service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:42.508006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-28e7b0d9-d950-48c3-a985-53f7da0b4e8f req-f9c1afea-f6be-4f9f-b4b1-7d8ee9aae5bc service nova] Creating event network-vif-deleted:db33472c-c494-43af-8f07-e9443ae30e6d for instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 on hv-cinder-86160 Oct 17 18:06:42.513178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-28e7b0d9-d950-48c3-a985-53f7da0b4e8f req-f9c1afea-f6be-4f9f-b4b1-7d8ee9aae5bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 Oct 17 18:06:42.513832 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 555/1088] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:42.787451 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:42.788985 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:42.805098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:42.805098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:42.805098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:42.805098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:42.805491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:42.805491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:42.868547 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:42.871013 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:42.877876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:42.878437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:42.878931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:42.879703 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:42.880503 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:42.881053 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:42.881181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:42.892775 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1f9bc5a6-fe83-42e4-8364-4121d2fc2a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1226 microversion: 2.1 time: 0.113892 Oct 17 18:06:42.893792 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 534/1089] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:42 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:42.927611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-009ada1d-2b68-4ada-937a-a22fe3432f2c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064415 Oct 17 18:06:42.928188 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 556/1090] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:42 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:06:43.073318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:43.073815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:43.079700 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.080181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.080642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.081330 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.081874 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.082308 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.110922 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-067fd775-946e-4221-92fc-4136a82ab2d0 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/a8c610af-3033-4abf-a98b-d70d5d8c4edf" status: 200 len: 194 microversion: 2.1 time: 0.042324 Oct 17 18:06:43.116989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 535/1091] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Oct 17 18:06:43 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/a8c610af-3033-4abf-a98b-d70d5d8c4edf => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:43.123092 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:43.123578 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:43.129373 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.129840 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.130263 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.130934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.131375 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.131790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.215642 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lazy-loading 'services' on Instance uuid 583d5cc9-1197-4c23-8e44-9f707ab0e73d {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:06:43.433961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-784182e4-3cf3-4a28-a828-68a3c77f9289 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/a8c610af-3033-4abf-a98b-d70d5d8c4edf" status: 202 len: 0 microversion: 2.1 time: 0.314919 Oct 17 18:06:43.434533 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 557/1092] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:06:43 2022] DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/a8c610af-3033-4abf-a98b-d70d5d8c4edf => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:06:43.917665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:43.918265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:43.924870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.925348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.925784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.926525 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.926977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.927400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.957921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:43.958394 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:43.958828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:43.959272 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lazy-loading 'fault' on Instance uuid dd55b7a8-181b-4125-9eeb-ab9d766f8d81 {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:06:44.000220 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:44.008054 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-aaff184c-de80-40ab-869a-3fd4956f1211 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 200 len: 1231 microversion: 2.1 time: 0.095024 Oct 17 18:06:44.008639 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 536/1093] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:43 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:45.032434 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:45.033184 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: dd55b7a8-181b-4125-9eeb-ab9d766f8d81] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:45.039726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:45.040250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:45.040775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:45.041475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:45.041925 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:45.042348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:45.056411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] HTTP exception thrown: Instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 could not be found. Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Request method failure captured: Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 HTTP/1.1 Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZezxJ-aFNqAiu7NbKAfP-V9SDsvbiBfuGLm0TjGHTRy_XFrq4kAtgKkV2XiV7xKHcYYAnstrFpBBbmXzY39WDYFY_7Xp5b69AmtYlfoJNRvEnQcm49YqgausAQoO_BkmDzOYuLVUR1lSEbx69BTvzblL4RybT6LmtW3ag_g7uRZYbg Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:06:45.058339 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1c70a04a649248c6a629325d44c380b9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}] Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: ec7790cac2cb4e7cb68b5a2e3a91d5ec Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 could not be found. Oct 17 18:06:45.060093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'dd55b7a8-181b-4125-9eeb-ab9d766f8d81'} Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 could not be found. Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:06:45.061094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 could not be found. Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 could not be found. Oct 17 18:06:45.062784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:45.064250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Returning 404 to user: Instance dd55b7a8-181b-4125-9eeb-ab9d766f8d81 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:06:45.064250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-208e89a4-7b67-49a9-8aa7-0b069e1c0969 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81" status: 404 len: 111 microversion: 2.1 time: 0.032099 Oct 17 18:06:45.064250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 558/1094] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:45 2022] GET /compute/v2.1/servers/dd55b7a8-181b-4125-9eeb-ab9d766f8d81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:06:45.610749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:45.611265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:45.620052 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:45.620553 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:45.621008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:45.621687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:45.622133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:45.622551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:45.651131 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2eba48b7-da8e-4e84-8fbd-1dce5a9b8afd tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/840a6ba8-bbb4-4092-a003-82f94ac9dbd7" status: 200 len: 194 microversion: 2.1 time: 0.044446 Oct 17 18:06:45.651708 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 537/1095] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Oct 17 18:06:45 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/840a6ba8-bbb4-4092-a003-82f94ac9dbd7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:45.662251 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:45.662732 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:45.669073 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:45.669548 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:45.669977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:45.670654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:45.671095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:45.671510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:45.751940 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lazy-loading 'services' on Instance uuid 583d5cc9-1197-4c23-8e44-9f707ab0e73d {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:06:45.963944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-20abe79a-d45f-42b7-9a25-118a83531e4c tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/840a6ba8-bbb4-4092-a003-82f94ac9dbd7" status: 202 len: 0 microversion: 2.1 time: 0.305469 Oct 17 18:06:45.964528 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 559/1096] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:06:45 2022] DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments/840a6ba8-bbb4-4092-a003-82f94ac9dbd7 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:06:47.147332 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:47.149870 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:47.156670 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:47.157152 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:47.157582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:47.158266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:47.158716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:47.159215 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:47.190246 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-bf353a60-df66-468c-ad37-de375771d2bb tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Oct 17 18:06:47.190802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 538/1097] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:47 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:48.204196 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:48.206963 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:48.213325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.213803 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.214237 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.214958 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.215400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.215814 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.245310 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-795f4307-f1f4-4393-9fde-14bb0d629ade tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046118 Oct 17 18:06:48.246102 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 560/1098] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:48 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:06:48.369282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:48.371558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:48.378080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.378636 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.379158 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.379916 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.380463 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.381121 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.410877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a6b09af2-abc2-48a7-b891-550d4a454e46 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045858 Oct 17 18:06:48.411447 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 539/1099] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:48 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:06:48.475905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:48.476397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:48.483116 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.483598 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.484050 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.484726 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.485176 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.485597 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.511593 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:06:48.690562 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:48.691147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:48.698773 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.700681 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.700681 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.700681 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.701004 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.701384 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.729921 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:06:48.867110 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fc340284-35ad-4159-911d-2c7ad8b4aa45 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 204 len: 0 microversion: 2.1 time: 0.394711 Oct 17 18:06:48.867837 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 561/1100] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:06:48 2022] DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:06:48.873291 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-245bb652-db64-4605-a350-f1f0e5b2d183 req-88ea2b68-339b-4cbe-9633-a3870f764096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949c71e4-fa50-47d6-ac7e-522194d40d7a", "tag": "0ad73db8-daee-4a82-827a-4ff8e9c3a0b6"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:48.882895 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-245bb652-db64-4605-a350-f1f0e5b2d183 req-88ea2b68-339b-4cbe-9633-a3870f764096 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.884077 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-245bb652-db64-4605-a350-f1f0e5b2d183 req-88ea2b68-339b-4cbe-9633-a3870f764096 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.884734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-245bb652-db64-4605-a350-f1f0e5b2d183 req-88ea2b68-339b-4cbe-9633-a3870f764096 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.897466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-245bb652-db64-4605-a350-f1f0e5b2d183 req-88ea2b68-339b-4cbe-9633-a3870f764096 service nova] Creating event network-changed:0ad73db8-daee-4a82-827a-4ff8e9c3a0b6 for instance 949c71e4-fa50-47d6-ac7e-522194d40d7a on hv-cinder-86160 Oct 17 18:06:48.903069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-245bb652-db64-4605-a350-f1f0e5b2d183 req-88ea2b68-339b-4cbe-9633-a3870f764096 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Oct 17 18:06:48.903654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 562/1101] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:48.908933 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:48.909970 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:48.916014 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.916499 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.916971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:48.917672 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:48.918123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:48.918543 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:49.006999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-eb915889-66f6-4c90-94b6-267b30a72126 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 204 len: 0 microversion: 2.1 time: 0.320290 Oct 17 18:06:49.011407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 540/1102] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:06:48 2022] DELETE /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:06:49.016722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:49.017432 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:49.023490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:49.024497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:49.025133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:49.026032 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:49.026492 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:49.026919 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:49.058012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:49.066571 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7c857db5-948d-4ca0-91a1-04e71d81055f tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1673 microversion: 2.1 time: 0.161542 Oct 17 18:06:49.068540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 563/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:48 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:49.177196 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:49.185962 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-be0024d0-0f1c-4d31-8686-56d40e4a1a26 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1576 microversion: 2.1 time: 0.173361 Oct 17 18:06:49.186539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 541/1104] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:49 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:06:50.091190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:50.091798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:50.098224 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:50.098705 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:50.099139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:50.099820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:50.100272 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:50.100728 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:50.209362 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:50.210286 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:50.217461 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:50.218017 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:50.218519 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:50.219271 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:50.219811 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:50.220423 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:50.227849 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:50.235510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c8f516d2-49c1-4aa9-884d-5d3c0ccf8d05 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1673 microversion: 2.1 time: 0.148209 Oct 17 18:06:50.236080 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 564/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:50 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:50.349601 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:50.358234 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-32582c8d-9608-4b88-81cf-79900f466a05 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1576 microversion: 2.1 time: 0.152665 Oct 17 18:06:50.358803 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 542/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:50 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:06:51.259808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:51.260446 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:51.266851 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:51.267333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:51.267769 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:51.268454 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:51.268935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:51.269357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:51.435508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:51.435508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d0d72988-1a04-4165-ac86-26e4751fdb42 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1673 microversion: 2.1 time: 0.151980 Oct 17 18:06:51.435508 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 565/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:51 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:51.436765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:51.437399 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:51.443662 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:51.444129 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:51.444556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:51.445251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:51.445721 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:51.446320 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:51.448960 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:06:51.576521 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:51.584485 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cb4c28fc-6f59-42d0-a8f5-97cfe76001ba tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1576 microversion: 2.1 time: 0.151726 Oct 17 18:06:51.585070 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 543/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:51 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:52.432920 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:52.433510 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:52.440029 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:52.440514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:52.440988 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:52.441690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:52.442136 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:52.442551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:52.445570 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:06:52.608889 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:52.609666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:52.616973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:52.617500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:52.619074 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:52.619795 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:52.620258 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:52.620707 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:53.004947 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:53.007545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:53.012185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5bdb7386-9080-439f-a1e5-a4d0112436df tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1673 microversion: 2.1 time: 0.584899 Oct 17 18:06:53.018300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5a777bbe-e8c6-42e1-9112-7d146e9754b0 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1576 microversion: 2.1 time: 0.413261 Oct 17 18:06:53.018917 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 544/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:52 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1576 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:53.024288 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-c319fd81-5bc9-4d8d-98e5-7c31d7256bd0 req-9a757ce2-d738-49b8-835c-2f1a45882f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949c71e4-fa50-47d6-ac7e-522194d40d7a", "name": "network-vif-deleted", "tag": "0ad73db8-daee-4a82-827a-4ff8e9c3a0b6"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:53.029859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 566/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:52 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1673 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:53.034059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c319fd81-5bc9-4d8d-98e5-7c31d7256bd0 req-9a757ce2-d738-49b8-835c-2f1a45882f0c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:53.034570 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c319fd81-5bc9-4d8d-98e5-7c31d7256bd0 req-9a757ce2-d738-49b8-835c-2f1a45882f0c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:53.035013 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-c319fd81-5bc9-4d8d-98e5-7c31d7256bd0 req-9a757ce2-d738-49b8-835c-2f1a45882f0c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:53.046646 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-c319fd81-5bc9-4d8d-98e5-7c31d7256bd0 req-9a757ce2-d738-49b8-835c-2f1a45882f0c service nova] Creating event network-vif-deleted:0ad73db8-daee-4a82-827a-4ff8e9c3a0b6 for instance 949c71e4-fa50-47d6-ac7e-522194d40d7a on hv-cinder-86160 Oct 17 18:06:53.051535 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-c319fd81-5bc9-4d8d-98e5-7c31d7256bd0 req-9a757ce2-d738-49b8-835c-2f1a45882f0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Oct 17 18:06:53.052165 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 545/1111] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:53.510137 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-995795517"}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:53.511319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:53.517626 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:53.518232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:53.518915 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:53.519687 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:53.520319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:53.520964 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:53.737898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.network.security_group_api [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Removing security group 92c98802-608e-4b37-a2f8-7223fac4f756 from port d001871d-63fc-4098-b674-c25e95104541 Oct 17 18:06:54.035927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:54.037348 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:54.045716 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:54.046484 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:54.047961 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:54.048908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:54.049532 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:54.050534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:54.151326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:54.159457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8b01ed6a-1f35-4948-9f81-c1f0bc07ac12 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1606 microversion: 2.1 time: 0.127611 Oct 17 18:06:54.160386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 546/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:54 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1606 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:06:54.322427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-1f06f12f-2c9f-4f79-ab4f-7b134268be41 req-de3f5462-d2c6-465e-a334-cc622079fdce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583d5cc9-1197-4c23-8e44-9f707ab0e73d", "name": "network-vif-deleted", "tag": "aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:54.332552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-1f06f12f-2c9f-4f79-ab4f-7b134268be41 req-de3f5462-d2c6-465e-a334-cc622079fdce service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:54.333497 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-1f06f12f-2c9f-4f79-ab4f-7b134268be41 req-de3f5462-d2c6-465e-a334-cc622079fdce service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:54.334136 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-1f06f12f-2c9f-4f79-ab4f-7b134268be41 req-de3f5462-d2c6-465e-a334-cc622079fdce service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:54.353401 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-1f06f12f-2c9f-4f79-ab4f-7b134268be41 req-de3f5462-d2c6-465e-a334-cc622079fdce service nova] Creating event network-vif-deleted:aebc3d4b-5e1e-408f-b7d8-9b69783d4c0e for instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d on hv-cinder-86160 Oct 17 18:06:54.358354 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-1f06f12f-2c9f-4f79-ab4f-7b134268be41 req-de3f5462-d2c6-465e-a334-cc622079fdce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196514 Oct 17 18:06:54.359157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 547/1113] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:54.359617 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-8afbba3f-92af-4475-ac18-14748575d2ed tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/action" status: 202 len: 0 microversion: 2.1 time: 0.854941 Oct 17 18:06:54.364706 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 567/1114] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:06:53 2022] POST /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:06:54.365150 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:54.366626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:54.373274 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:54.374000 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:54.374631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:54.375609 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:54.376232 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:54.377346 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:54.418522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:54.419280 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:54.419882 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:54.421072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lazy-loading 'fault' on Instance uuid 949c71e4-fa50-47d6-ac7e-522194d40d7a {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:06:54.495251 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7790cac2cb4e7cb68b5a2e3a91d5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c70a04a649248c6a629325d44c380b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:54.505486 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-557ee71b-4921-46e5-9689-4b0cfd3c8be6 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 200 len: 1397 microversion: 2.1 time: 0.144850 Oct 17 18:06:54.506445 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 548/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:54 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 1397 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:55.186800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:55.186800 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:55.196347 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.196859 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.197315 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.201668 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.202161 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.202865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.246163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.246651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.247087 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.247536 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lazy-loading 'fault' on Instance uuid 583d5cc9-1197-4c23-8e44-9f707ab0e73d {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:06:55.300565 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77324aa35534726b030564b5b70fb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d7fb8ced44d4a4fb84e3fd806c436d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:06:55.312686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-875af00d-bd0d-4163-b629-765b7a4ac525 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 200 len: 1328 microversion: 2.1 time: 0.132784 Oct 17 18:06:55.313326 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 568/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:55 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 1328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:06:55.530840 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:55.532008 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 949c71e4-fa50-47d6-ac7e-522194d40d7a] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:55.538226 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.538707 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.539717 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.540747 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.541203 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.541626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.556522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] HTTP exception thrown: Instance 949c71e4-fa50-47d6-ac7e-522194d40d7a could not be found. Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Request method failure captured: Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a HTTP/1.1 Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZezxJ-aFNqAiu7NbKAfP-V9SDsvbiBfuGLm0TjGHTRy_XFrq4kAtgKkV2XiV7xKHcYYAnstrFpBBbmXzY39WDYFY_7Xp5b69AmtYlfoJNRvEnQcm49YqgausAQoO_BkmDzOYuLVUR1lSEbx69BTvzblL4RybT6LmtW3ag_g7uRZYbg Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:06:55.558564 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1c70a04a649248c6a629325d44c380b9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}] Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: ec7790cac2cb4e7cb68b5a2e3a91d5ec Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 949c71e4-fa50-47d6-ac7e-522194d40d7a could not be found. Oct 17 18:06:55.560311 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '949c71e4-fa50-47d6-ac7e-522194d40d7a'} Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949c71e4-fa50-47d6-ac7e-522194d40d7a could not be found. Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:06:55.561954 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949c71e4-fa50-47d6-ac7e-522194d40d7a could not be found. Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949c71e4-fa50-47d6-ac7e-522194d40d7a could not be found. Oct 17 18:06:55.563968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:55.565739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Returning 404 to user: Instance 949c71e4-fa50-47d6-ac7e-522194d40d7a could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:06:55.565739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4f02400d-c8eb-453a-9596-3e072c69fc6c tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a" status: 404 len: 111 microversion: 2.1 time: 0.035922 Oct 17 18:06:55.565739 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 549/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:55 2022] GET /compute/v2.1/servers/949c71e4-fa50-47d6-ac7e-522194d40d7a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:06:55.685691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:55.686188 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:55.696586 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.697240 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.697779 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.698611 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:55.699165 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:55.699694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:55.789186 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lazy-loading 'services' on Instance uuid 1dff1fb4-3506-4df3-b4de-e829f19e773c {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:06:56.043048 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-03de5fdd-5ab3-4071-8db0-01ba72faa1f6 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments/2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9" status: 202 len: 0 microversion: 2.1 time: 0.361578 Oct 17 18:06:56.047961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 569/1118] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:06:55 2022] DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments/2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:06:56.052385 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:56.056300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:56.063257 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.064147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.064661 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.065590 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.066327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.066752 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.099407 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-12452169-27f3-43b8-9145-44caa93cf824 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051061 Oct 17 18:06:56.100208 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 550/1119] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:56 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:56.119688 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:56.120264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:56.129518 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.130103 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.130534 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.131219 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.131663 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.132075 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.147613 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] HTTP exception thrown: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Request method failure captured: Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab HTTP/1.1 Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZezxJ-aFNqAiu7NbKAfP-V9SDsvbiBfuGLm0TjGHTRy_XFrq4kAtgKkV2XiV7xKHcYYAnstrFpBBbmXzY39WDYFY_7Xp5b69AmtYlfoJNRvEnQcm49YqgausAQoO_BkmDzOYuLVUR1lSEbx69BTvzblL4RybT6LmtW3ag_g7uRZYbg Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:06:56.150027 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1c70a04a649248c6a629325d44c380b9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}] Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: ec7790cac2cb4e7cb68b5a2e3a91d5ec Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.151759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '0aed4c63-5f40-4c41-b922-937d81e91fab'} Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:06:56.152702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.154358 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.156221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Returning 404 to user: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:06:56.156221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-6f68dd58-ad49-4c8a-a791-30a50c1fc962 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 404 len: 111 microversion: 2.1 time: 0.036564 Oct 17 18:06:56.156221 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 570/1120] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:06:56 2022] DELETE /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:06:56.160992 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:56.161665 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] [instance: 0aed4c63-5f40-4c41-b922-937d81e91fab] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:56.171134 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.171769 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.172289 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.173145 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.173914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.174351 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.189368 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] HTTP exception thrown: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Request method failure captured: Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab HTTP/1.1 Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZezxJ-aFNqAiu7NbKAfP-V9SDsvbiBfuGLm0TjGHTRy_XFrq4kAtgKkV2XiV7xKHcYYAnstrFpBBbmXzY39WDYFY_7Xp5b69AmtYlfoJNRvEnQcm49YqgausAQoO_BkmDzOYuLVUR1lSEbx69BTvzblL4RybT6LmtW3ag_g7uRZYbg Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:06:56.190968 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1c70a04a649248c6a629325d44c380b9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1c70a04a649248c6a629325d44c380b9"}]}] Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 1c70a04a649248c6a629325d44c380b9 Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027318872 Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: ec7790cac2cb4e7cb68b5a2e3a91d5ec Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-TestVolumeBootPattern-2027318872-project Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.192713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '0aed4c63-5f40-4c41-b922-937d81e91fab'} Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:06:56.193693 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. Oct 17 18:06:56.195848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.197284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Returning 404 to user: Instance 0aed4c63-5f40-4c41-b922-937d81e91fab could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:06:56.197284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-b1c94414-c6e8-44aa-aba2-3f6be2b2cf85 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab" status: 404 len: 111 microversion: 2.1 time: 0.036615 Oct 17 18:06:56.197284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 551/1121] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:56 2022] GET /compute/v2.1/servers/0aed4c63-5f40-4c41-b922-937d81e91fab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:06:56.339433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:56.340043 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:56.346488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.346963 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.347397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.348088 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.348538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.348989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.363093 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] HTTP exception thrown: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Request method failure captured: Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d HTTP/1.1 Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZij0S__pAMI8a1Jc-fLdfJi4FLIs6G0_NG7LbCmZYlOgNevnZW_51bVZqk1R_dRCIYiMk_f3Mtw9_Z_i5Na6hGLT88oW9fUORWzDE_m-V-YBzpk1p7jyY0fBLSvXide-rfgo9fivDej9M6EBELHEYvLPut5uLYU0Ly9-B_WipiAt8k Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:06:56.364679 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d7fb8ced44d4a4fb84e3fd806c436d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}] Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: b77324aa35534726b030564b5b70fb22 Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:06:56.366185 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '583d5cc9-1197-4c23-8e44-9f707ab0e73d'} Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:06:56.366974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:06:56.368841 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:06:56.369978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Returning 404 to user: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:06:56.369978 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ae5357f4-4086-461d-b26b-ac5f50408d06 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 404 len: 111 microversion: 2.1 time: 0.030731 Oct 17 18:06:56.370935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 571/1122] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:56 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:06:56.376849 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-63a9abb9-3890-4200-b3cd-e0273c6f104b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '.version_select at 0x7f01998edf70>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:56.405735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "tag": "d001871d-63fc-4098-b674-c25e95104541"}, {"name": "network-changed", "server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "tag": "d001871d-63fc-4098-b674-c25e95104541"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:06:56.416603 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:56.417129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:56.417549 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:56.431264 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] Creating event network-changed:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:06:56.431792 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] Creating event network-changed:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:06:56.437118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-f16165f3-e80a-4e24-93ba-3de38fcb2d89 req-14f3292b-129c-45e4-bc09-c7f65303c765 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035538 Oct 17 18:06:56.437711 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 572/1123] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:06:56.466357 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-63a9abb9-3890-4200-b3cd-e0273c6f104b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398104804" status: 202 len: 0 microversion: 2.1 time: 0.094221 Oct 17 18:06:56.468808 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 552/1124] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Oct 17 18:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398104804 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:06:57.114456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:57.116747 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:57.123023 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:57.123492 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:57.123921 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:57.124613 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:57.125051 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:57.125462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:57.156476 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a2bafafe-d10c-423a-9053-a2a0d1aa294b tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Oct 17 18:06:57.156977 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 573/1125] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:57 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:06:57.784062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f59f8552-1334-4c00-be64-dde53e833544 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] Calling method '.version_select at 0x7f01962edc10>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:57.856930 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f59f8552-1334-4c00-be64-dde53e833544 tempest-TestVolumeBootPattern-2027318872 tempest-TestVolumeBootPattern-2027318872-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1896343550" status: 202 len: 0 microversion: 2.1 time: 0.076693 Oct 17 18:06:57.857513 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 553/1126] 10.222.0.58 () {58 vars in 1263 bytes} [Mon Oct 17 18:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1896343550 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:06:58.170006 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:58.172190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:58.178686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:58.179163 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:58.179589 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:58.180900 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:58.181418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:58.182090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:58.211919 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0a71e4f3-e1b0-4c5c-ac97-8b6f054ab34c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045792 Oct 17 18:06:58.212820 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 574/1127] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 17 18:06:58 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 18:06:58.223534 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:58.224024 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:58.231007 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:58.231489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:58.231927 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:58.232651 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:58.233107 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:58.233533 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:58.310256 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] HTTP exception thrown: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c is not attached to volume 2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Request method failure captured: Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments/2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 HTTP/1.1 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZkqjcCegRQzYR-Pd3GM5_CGCQGHr1LqqsifN52qQ5PqEXuMmIRtzHBTxRsTliMnDd9y4Cg5L3hZVpSuoRUyR6Jpq3d1Tht11_OcUcuUpraMd-MbJBGnlMNYAdCziitSWA5vhUoN0DZJpJ0w2r44Gu7wRJcQKEeX-mFAw2VNefZsy1E Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: dbc61f6f9888420ab54b40ad65d9e689 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-TestMinimumBasicScenario-1210664802 Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:06:58.312500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dbc61f6f9888420ab54b40ad65d9e689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dbc61f6f9888420ab54b40ad65d9e689", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dbc61f6f9888420ab54b40ad65d9e689"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dbc61f6f9888420ab54b40ad65d9e689"}]}] Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-TestMinimumBasicScenario-1210664802 Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: dbc61f6f9888420ab54b40ad65d9e689 Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1210664802 Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-TestMinimumBasicScenario-1210664802-project Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: 46c1a45edba44bb5bd0d80822b4c0047 Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-TestMinimumBasicScenario-1210664802-project Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:06:58.314712 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c is not attached to volume 2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'server_id': '1dff1fb4-3506-4df3-b4de-e829f19e773c', 'id': '2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9'} Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9. Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:06:58.315523 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c is not attached to volume 2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c is not attached to volume 2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:06:58.316834 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Returning 404 to user: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c is not attached to volume 2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:06:58.317848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-5a9887fa-ce81-4eb0-b6a9-d32ce5aefd75 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments/2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9" status: 404 len: 154 microversion: 2.1 time: 0.094532 Oct 17 18:06:58.317848 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 554/1128] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 17 18:06:58 2022] DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c/os-volume_attachments/2e8c2a9b-c9fb-4f68-b61e-ddee4a9cfed9 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:06:59.596848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:59.597348 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:59.604560 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:59.605078 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:59.605539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:59.606240 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:59.606694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:59.607118 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:59.640656 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Going to try to terminate instance {{(pid=126519) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:06:59.956234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-fac05d4d-0d41-4b86-80c6-48a1b6a7c739 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 204 len: 0 microversion: 2.1 time: 0.362728 Oct 17 18:06:59.957609 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 575/1129] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:06:59 2022] DELETE /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:06:59.966555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:59.967184 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:59.976181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:59.976801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:59.977237 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:59.978178 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:06:59.978642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:06:59.982075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:06:59.988998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:06:59.989936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:06:59.999287 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:00.003115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:00.003714 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:00.005832 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:00.009115 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:00.019044 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:00.037545 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] HTTP exception thrown: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Request method failure captured: Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d HTTP/1.1 Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZij0S__pAMI8a1Jc-fLdfJi4FLIs6G0_NG7LbCmZYlOgNevnZW_51bVZqk1R_dRCIYiMk_f3Mtw9_Z_i5Na6hGLT88oW9fUORWzDE_m-V-YBzpk1p7jyY0fBLSvXide-rfgo9fivDej9M6EBELHEYvLPut5uLYU0Ly9-B_WipiAt8k Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:07:00.040150 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d7fb8ced44d4a4fb84e3fd806c436d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}] Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: b77324aa35534726b030564b5b70fb22 Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.041793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '583d5cc9-1197-4c23-8e44-9f707ab0e73d'} Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:07:00.043139 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.044455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.047475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Returning 404 to user: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:07:00.048583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b4c68608-e9a4-4ee8-9e4b-b811dab3a54b tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 404 len: 111 microversion: 2.1 time: 0.064999 Oct 17 18:07:00.049865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 576/1130] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:06:59 2022] DELETE /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:07:00.058616 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:00.059342 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: 583d5cc9-1197-4c23-8e44-9f707ab0e73d] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:00.066250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:00.067094 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:00.068127 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:00.069140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:00.069989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:00.072490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:00.089622 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] HTTP exception thrown: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Request method failure captured: Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d HTTP/1.1 Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZij0S__pAMI8a1Jc-fLdfJi4FLIs6G0_NG7LbCmZYlOgNevnZW_51bVZqk1R_dRCIYiMk_f3Mtw9_Z_i5Na6hGLT88oW9fUORWzDE_m-V-YBzpk1p7jyY0fBLSvXide-rfgo9fivDej9M6EBELHEYvLPut5uLYU0Ly9-B_WipiAt8k Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:07:00.091511 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d7fb8ced44d4a4fb84e3fd806c436d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}] Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: b77324aa35534726b030564b5b70fb22 Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.093250 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '583d5cc9-1197-4c23-8e44-9f707ab0e73d'} Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:07:00.094206 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. Oct 17 18:07:00.095766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:00.098045 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Returning 404 to user: Instance 583d5cc9-1197-4c23-8e44-9f707ab0e73d could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:07:00.099026 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-445f0152-f39c-4f35-ae05-65f07d045937 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d" status: 404 len: 111 microversion: 2.1 time: 0.045223 Oct 17 18:07:00.102934 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 577/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:00 2022] GET /compute/v2.1/servers/583d5cc9-1197-4c23-8e44-9f707ab0e73d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 18:07:00.430472 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:00.438545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-6790bca3-518e-4130-9172-5ffa2010ab41 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1555 microversion: 2.1 time: 0.476054 Oct 17 18:07:00.440631 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 555/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:06:59 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1555 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:01.436466 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:01.437038 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:01.443325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:01.443797 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:01.444247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:01.444946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:01.445875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:01.446448 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:01.459602 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] HTTP exception thrown: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Request method failure captured: Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 HTTP/1.1 Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZij0S__pAMI8a1Jc-fLdfJi4FLIs6G0_NG7LbCmZYlOgNevnZW_51bVZqk1R_dRCIYiMk_f3Mtw9_Z_i5Na6hGLT88oW9fUORWzDE_m-V-YBzpk1p7jyY0fBLSvXide-rfgo9fivDej9M6EBELHEYvLPut5uLYU0Ly9-B_WipiAt8k Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:07:01.461961 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d7fb8ced44d4a4fb84e3fd806c436d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}] Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: b77324aa35534726b030564b5b70fb22 Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.463459 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906'} Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:07:01.464228 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.465585 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.466957 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Returning 404 to user: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:07:01.467039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:01.467477 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e9138e74-e2fe-480f-aa1b-2d84da2b4f04 tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 404 len: 111 microversion: 2.1 time: 0.030684 Oct 17 18:07:01.467567 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:01.467666 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 578/1133] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:07:01 2022] DELETE /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:07:01.470276 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:01.470733 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:01.471173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:01.471931 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:01.472039 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:01.472321 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:01.472439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] [instance: ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:01.472777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:01.478463 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:01.478936 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:01.479367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:01.480244 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:01.480620 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:01.481372 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:01.495301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] HTTP exception thrown: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Request method failure captured: Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 HTTP/1.1 Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZij0S__pAMI8a1Jc-fLdfJi4FLIs6G0_NG7LbCmZYlOgNevnZW_51bVZqk1R_dRCIYiMk_f3Mtw9_Z_i5Na6hGLT88oW9fUORWzDE_m-V-YBzpk1p7jyY0fBLSvXide-rfgo9fivDej9M6EBELHEYvLPut5uLYU0Ly9-B_WipiAt8k Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:07:01.496865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4d7fb8ced44d4a4fb84e3fd806c436d6", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4d7fb8ced44d4a4fb84e3fd806c436d6"}]}] Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: 4d7fb8ced44d4a4fb84e3fd806c436d6 Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-595386441 Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: b77324aa35534726b030564b5b70fb22 Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-AttachVolumeTestJSON-595386441-project Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.498623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': 'ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906'} Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:07:01.499654 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. Oct 17 18:07:01.501577 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:01.502990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] Returning 404 to user: Instance ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:07:01.502990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-2d15c8d1-9bb6-47a5-8ffc-93865477b5ac tempest-AttachVolumeTestJSON-595386441 tempest-AttachVolumeTestJSON-595386441-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906" status: 404 len: 111 microversion: 2.1 time: 0.030169 Oct 17 18:07:01.502990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 579/1134] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:01 2022] GET /compute/v2.1/servers/ec1540fb-d9bf-40ed-8d0b-cd91fcb8a906 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:07:01.637337 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:01.648319 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-02864df9-ec13-4653-9c20-f834ca6b3f4c tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1555 microversion: 2.1 time: 0.189926 Oct 17 18:07:01.650822 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 556/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:01 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:07:02.363749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-b845405f-7488-468d-a89b-ac0463b00715 req-d36dfa78-2881-4ef5-863f-737d0ab9106e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dff1fb4-3506-4df3-b4de-e829f19e773c", "name": "network-vif-deleted", "tag": "d001871d-63fc-4098-b674-c25e95104541"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:07:02.363749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-b845405f-7488-468d-a89b-ac0463b00715 req-d36dfa78-2881-4ef5-863f-737d0ab9106e service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:02.363749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-b845405f-7488-468d-a89b-ac0463b00715 req-d36dfa78-2881-4ef5-863f-737d0ab9106e service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:02.363749 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-b845405f-7488-468d-a89b-ac0463b00715 req-d36dfa78-2881-4ef5-863f-737d0ab9106e service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:02.376138 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-b845405f-7488-468d-a89b-ac0463b00715 req-d36dfa78-2881-4ef5-863f-737d0ab9106e service nova] Creating event network-vif-deleted:d001871d-63fc-4098-b674-c25e95104541 for instance 1dff1fb4-3506-4df3-b4de-e829f19e773c on hv-cinder-86160 Oct 17 18:07:02.381077 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-b845405f-7488-468d-a89b-ac0463b00715 req-d36dfa78-2881-4ef5-863f-737d0ab9106e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Oct 17 18:07:02.381935 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 580/1136] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:07:02.673724 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:02.674353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:02.683199 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:02.683942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:02.684552 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:02.685284 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:02.685731 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:02.686156 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:02.747161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:02.748733 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:02.749415 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:02.750594 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.objects.instance [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lazy-loading 'fault' on Instance uuid 1dff1fb4-3506-4df3-b4de-e829f19e773c {{(pid=126522) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:07:02.843531 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46c1a45edba44bb5bd0d80822b4c0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc61f6f9888420ab54b40ad65d9e689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:02.848737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-156ee7b1-42f4-489a-9450-2f28069a7e1a tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 200 len: 1349 microversion: 2.1 time: 0.178871 Oct 17 18:07:02.849324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 557/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:02 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 1349 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:03.883357 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:03.884168 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] [instance: 1dff1fb4-3506-4df3-b4de-e829f19e773c] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:03.903785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:03.904634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:03.905972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:03.907460 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:03.908158 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:03.909199 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:03.939457 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.wsgi [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] HTTP exception thrown: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c could not be found. Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Request method failure captured: Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: request: GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c HTTP/1.1 Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept: application/json Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Accept-Encoding: identity Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Connection: close Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Length: 0 Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Content-Type: application/json Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Host: 10.222.0.58 Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Openstack-System-Scope: None Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: User-Agent: python-urllib3/1.26.12 Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Auth-Token: gAAAAABjTZkqjcCegRQzYR-Pd3GM5_CGCQGHr1LqqsifN52qQ5PqEXuMmIRtzHBTxRsTliMnDd9y4Cg5L3hZVpSuoRUyR6Jpq3d1Tht11_OcUcuUpraMd-MbJBGnlMNYAdCziitSWA5vhUoN0DZJpJ0w2r44Gu7wRJcQKEeX-mFAw2VNefZsy1E Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Id: None Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Domain-Name: None Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Identity-Status: Confirmed Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Is-Admin-Project: True Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Id: default Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Domain-Name: Default Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Id: dbc61f6f9888420ab54b40ad65d9e689 Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Project-Name: tempest-TestMinimumBasicScenario-1210664802 Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Role: reader,member Oct 17 18:07:03.941455 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Roles: reader,member Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dbc61f6f9888420ab54b40ad65d9e689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dbc61f6f9888420ab54b40ad65d9e689", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dbc61f6f9888420ab54b40ad65d9e689"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dbc61f6f9888420ab54b40ad65d9e689"}]}] Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant: tempest-TestMinimumBasicScenario-1210664802 Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Id: dbc61f6f9888420ab54b40ad65d9e689 Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1210664802 Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User: tempest-TestMinimumBasicScenario-1210664802-project Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Id: default Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Domain-Name: Default Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Id: 46c1a45edba44bb5bd0d80822b4c0047 Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: X-User-Name: tempest-TestMinimumBasicScenario-1210664802-project Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: method: > Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: exception: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c could not be found. Oct 17 18:07:03.942864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: action_args: {'id': '1dff1fb4-3506-4df3-b4de-e829f19e773c'} Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c could not be found. Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:07:03.943762 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c could not be found. Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c could not be found. Oct 17 18:07:03.945344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR nova.api.openstack.wsgi Oct 17 18:07:03.948398 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Returning 404 to user: Instance 1dff1fb4-3506-4df3-b4de-e829f19e773c could not be found. {{(pid=126519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:07:03.951312 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-22459703-c1c1-4e50-9038-4765dfb4e787 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c" status: 404 len: 111 microversion: 2.1 time: 0.078126 Oct 17 18:07:03.960453 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 581/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:03 2022] GET /compute/v2.1/servers/1dff1fb4-3506-4df3-b4de-e829f19e773c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:07:03.966904 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f89ea899-4f7d-4da4-bf74-a8a2d9d79a58 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] Calling method '.version_select at 0x7f01963043a0>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:03.977207 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:07:04.117765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f89ea899-4f7d-4da4-bf74-a8a2d9d79a58 tempest-TestMinimumBasicScenario-1210664802 tempest-TestMinimumBasicScenario-1210664802-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1553249561" status: 202 len: 0 microversion: 2.1 time: 0.154510 Oct 17 18:07:04.119373 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 558/1139] 10.222.0.58 () {58 vars in 1272 bytes} [Mon Oct 17 18:07:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1553249561 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:07:29.402636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:07:29.403363 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:07:29.563303 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-818fea37-69e7-4781-ae78-6f03bf619954 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Action: 'create', calling method: .version_select at 0x7f01962a45e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1336473504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI1EmdnW6bybeshXo0H0Y8E5Yphxs11QB2JrDdMtZ6abnHFkvYLuAPrdOjJAHoCUywfbergE4VtvktcsbSrr3CXPtAJGE7t8qkXMonVMgpmQrZm6mYWX/pIddpLHhkpcQ=="}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:07:29.579475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-818fea37-69e7-4781-ae78-6f03bf619954 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Getting quotas for project 4fc7c3bfaf5640d4a68b7e6361c16c34. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:07:29.583253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.quota [None req-818fea37-69e7-4781-ae78-6f03bf619954 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Getting quotas for user fd9b0dca1ad744b9974173b777dc6b54 and project 4fc7c3bfaf5640d4a68b7e6361c16c34. Resources: {'key_pairs'} {{(pid=126519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:07:29.653174 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-818fea37-69e7-4781-ae78-6f03bf619954 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.256655 Oct 17 18:07:29.653775 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 582/1140] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 17 18:07:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 18:07:51.017815 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-903321194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1336473504", "security_groups": [{"name": "tempest-secgroup-smoke-1432627433"}], "networks": [{"uuid": "0841eff6-c43c-4f2a-b4eb-20cdab6d0701"}], "block_device_mapping_v2": [{"uuid": "71916ed3-9d54-4e6a-a8e8-a0758bb9ccc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:07:51.028765 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=65 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:07:51.135719 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.network.neutron [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] validate_networks() for [('0841eff6-c43c-4f2a-b4eb-20cdab6d0701', None, None, None, None, None)] {{(pid=126522) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 18:07:51.603639 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Flavor limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 18:07:51.604062 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Image limits 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 18:07:51.604558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Flavor pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 18:07:51.604987 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Image pref 0:0:0 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 18:07:51.605395 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.virt.hardware [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126522) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 18:07:51.614265 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:51.614744 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:51.615174 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:51.615895 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:51.616349 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:51.616817 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:51.633064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Getting quotas for project 4fc7c3bfaf5640d4a68b7e6361c16c34. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 18:07:51.637037 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.quota [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Getting quotas for user fd9b0dca1ad744b9974173b777dc6b54 and project 4fc7c3bfaf5640d4a68b7e6361c16c34. Resources: {'cores', 'instances', 'ram'} {{(pid=126522) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 18:07:51.695439 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Going to run 1 instances... {{(pid=126522) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 18:07:51.697613 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71916ed3-9d54-4e6a-a8e8-a0758bb9ccc5',volume_size=None,volume_type=None)] {{(pid=126522) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 18:07:52.068500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-25bfb938-fabe-4a5e-98c4-dabf5264db43 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.055295 Oct 17 18:07:52.069466 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 559/1141] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 17 18:07:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 18:07:52.087834 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=4 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:07:52.088634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:07:52.092581 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-38134ecf-19ee-4e60-baf9-a094b1be85dd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:52.093209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-38134ecf-19ee-4e60-baf9-a094b1be85dd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:52.147624 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-38134ecf-19ee-4e60-baf9-a094b1be85dd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:52.157472 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-38134ecf-19ee-4e60-baf9-a094b1be85dd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1088 microversion: 2.1 time: 0.070956 Oct 17 18:07:52.158011 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 583/1142] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:52 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:53.180972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2a3c1d23-654d-4cf5-b83a-8ec2cb38c7fd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:53.180972 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2a3c1d23-654d-4cf5-b83a-8ec2cb38c7fd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:53.233691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2a3c1d23-654d-4cf5-b83a-8ec2cb38c7fd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:53.241545 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2a3c1d23-654d-4cf5-b83a-8ec2cb38c7fd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1088 microversion: 2.1 time: 0.065549 Oct 17 18:07:53.242117 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 560/1143] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:53 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:54.263865 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-58407b1e-72dd-4b5e-a345-eb52692e1289 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:54.264502 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-58407b1e-72dd-4b5e-a345-eb52692e1289 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:54.331891 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-58407b1e-72dd-4b5e-a345-eb52692e1289 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:54.342519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-58407b1e-72dd-4b5e-a345-eb52692e1289 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1088 microversion: 2.1 time: 0.079815 Oct 17 18:07:54.342519 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 584/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:54 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:55.363443 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-afa62a5c-4f62-4061-910c-fd96d82358ea tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:55.364067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-afa62a5c-4f62-4061-910c-fd96d82358ea tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:55.417204 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-afa62a5c-4f62-4061-910c-fd96d82358ea tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:55.423964 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-afa62a5c-4f62-4061-910c-fd96d82358ea tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1088 microversion: 2.1 time: 0.065505 Oct 17 18:07:55.424541 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 561/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:55 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:56.447809 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:56.448413 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:56.454246 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:56.454718 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:56.455145 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:56.455828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:56.457159 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:56.457309 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:56.521254 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:56.528786 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-c0dd6eb9-3ee0-4df0-9191-b2511f936d7a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1138 microversion: 2.1 time: 0.085004 Oct 17 18:07:56.529337 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 585/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:56 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:57.552630 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:57.553970 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:57.561260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:57.561260 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:57.561478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:57.562043 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:57.562639 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:57.563073 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:57.626551 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:57.634711 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0f6d0e8b-36dd-4dc7-b0e4-364e42874b3b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1138 microversion: 2.1 time: 0.087401 Oct 17 18:07:57.640067 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 562/1147] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:57 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:58.658077 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:58.658843 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:58.666344 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:58.666954 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:58.667483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:58.668391 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:58.669535 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:58.670148 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:58.746592 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:07:58.754540 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-cfd19cfe-593d-4fb6-86e8-df5c23b18a16 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1194 microversion: 2.1 time: 0.100382 Oct 17 18:07:58.759717 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 586/1148] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:58 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:07:59.779412 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:07:59.780682 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:07:59.787242 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:59.787994 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:59.788621 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:07:59.789471 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:07:59.790173 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:07:59.790746 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:00.007208 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:00.023896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f4e9dfbb-259b-45bd-a9c7-56236ac9934f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1272 microversion: 2.1 time: 0.248240 Oct 17 18:08:00.025161 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 563/1149] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:07:59 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:00.572090 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-40b06eb3-5c6d-4f72-89e9-dcb0b810607b req-2d6d19a2-85c9-487d-80ee-a387b3ca92b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:08:00.587567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-40b06eb3-5c6d-4f72-89e9-dcb0b810607b req-2d6d19a2-85c9-487d-80ee-a387b3ca92b8 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:00.588189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-40b06eb3-5c6d-4f72-89e9-dcb0b810607b req-2d6d19a2-85c9-487d-80ee-a387b3ca92b8 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:00.588794 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-40b06eb3-5c6d-4f72-89e9-dcb0b810607b req-2d6d19a2-85c9-487d-80ee-a387b3ca92b8 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:00.601095 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-40b06eb3-5c6d-4f72-89e9-dcb0b810607b req-2d6d19a2-85c9-487d-80ee-a387b3ca92b8 service nova] Creating event network-changed:22a1b38e-04f6-4fe1-9f34-1d89c72c03fe for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 on hv-cinder-86160 Oct 17 18:08:00.608774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-40b06eb3-5c6d-4f72-89e9-dcb0b810607b req-2d6d19a2-85c9-487d-80ee-a387b3ca92b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043873 Oct 17 18:08:00.608774 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 587/1150] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:08:01.050057 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:01.050666 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:01.057573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:01.058291 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:01.058726 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:01.059425 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:01.059877 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:01.060300 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:01.267853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:01.275125 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-4125d8c0-7c93-42de-bd9d-9a47bcdc8bbb tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.229287 Oct 17 18:08:01.275701 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 564/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:01 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:02.299848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:02.300539 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:02.306623 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:02.307354 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:02.307784 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:02.308464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:02.308942 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:02.309362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:02.457249 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:02.465271 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b7c776d7-922f-4ab6-8a46-73741c840479 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.170256 Oct 17 18:08:02.465839 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 588/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:02 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:03.487912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:03.488505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:03.490366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=2 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:08:03.495605 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:03.496088 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:03.496522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:03.497238 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:03.497697 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:03.498126 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:03.630844 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:03.638511 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-9e5c3f0e-0e1d-43c1-8025-b2b12b43f431 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.155000 Oct 17 18:08:03.639059 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 565/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:03 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:04.663069 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:04.663686 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:04.670437 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell0:SELECT=4 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:08:04.672141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:04.672639 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:04.673065 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:04.673790 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:04.674235 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:04.675655 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:04.807889 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:04.816274 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-1b776428-8d1c-4fbe-b0a4-88eea42826b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.158284 Oct 17 18:08:04.816864 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 589/1154] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:04 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 18:08:05.839222 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:05.839823 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:05.842443 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell0:SELECT=10 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:08:05.847977 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:05.852658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:05.852658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:05.852658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:05.852658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:05.852996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:05.990240 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:05.998450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-0a0a7061-de8b-4ac5-afe2-7900a1a59129 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.163088 Oct 17 18:08:05.999064 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 566/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:05 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:07.022590 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:07.023190 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:07.029521 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:07.029997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:07.030424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:07.031100 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:07.031546 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:07.031962 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:07.162141 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:07.169798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-142361f1-9764-4569-9169-ae22ec9db44f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.151172 Oct 17 18:08:07.170362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 590/1156] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:07 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:08.195789 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:08.200764 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:08.205626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:08.206851 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:08.207511 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:08.208427 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:08.209120 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:08.209736 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:08.355076 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:08.364950 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a378c947-d439-41df-b9a9-a0461610fe18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.175105 Oct 17 18:08:08.365536 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 567/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:08 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:09.389189 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:09.389793 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:09.396280 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:09.396828 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:09.397306 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:09.397985 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:09.398434 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:09.398853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:09.532923 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:09.540720 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-be5676f0-12b7-4f0b-a072-2fe6a1ec5abf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.155805 Oct 17 18:08:09.541283 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 591/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:09 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:10.566802 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:10.567563 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:10.578327 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:10.584075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:10.584075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:10.584075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:10.584075 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:10.584505 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:10.722983 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:10.731616 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-a2942438-1017-4646-bd09-30f26bd16a01 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.171902 Oct 17 18:08:10.732491 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 568/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:10 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:11.756694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:11.757456 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:11.764489 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:11.765012 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:11.765442 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:11.766305 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:11.766759 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:11.767234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:11.931724 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:11.940671 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-090e27e0-ab2e-4e90-a1ae-c9f4c5ecb55d tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.189275 Oct 17 18:08:11.941234 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 592/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:11 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:12.965457 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:12.968133 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:12.974164 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:12.974828 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:12.975413 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:12.978421 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:12.978967 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:12.979478 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:13.128509 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:13.136821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1f41aff7-df77-4c00-9dda-adac20cd3d5e tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.175312 Oct 17 18:08:13.141099 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 569/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:12 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:14.083990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-ebb92d5d-2508-4d3a-9260-3614cdb65820 req-a0ac8fb5-35ae-4b79-a378-a075d8676822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "name": "network-vif-plugged", "status": "completed", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:08:14.093374 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-ebb92d5d-2508-4d3a-9260-3614cdb65820 req-a0ac8fb5-35ae-4b79-a378-a075d8676822 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:14.096635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-ebb92d5d-2508-4d3a-9260-3614cdb65820 req-a0ac8fb5-35ae-4b79-a378-a075d8676822 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:14.096635 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-ebb92d5d-2508-4d3a-9260-3614cdb65820 req-a0ac8fb5-35ae-4b79-a378-a075d8676822 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:14.105951 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-ebb92d5d-2508-4d3a-9260-3614cdb65820 req-a0ac8fb5-35ae-4b79-a378-a075d8676822 service nova] Creating event network-vif-plugged:22a1b38e-04f6-4fe1-9f34-1d89c72c03fe for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 on hv-cinder-86160 Oct 17 18:08:14.110911 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-ebb92d5d-2508-4d3a-9260-3614cdb65820 req-a0ac8fb5-35ae-4b79-a378-a075d8676822 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154511 Oct 17 18:08:14.111496 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 593/1162] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:08:14.165603 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:14.166896 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:14.178981 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:14.179590 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:14.180266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:14.180786 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:14.181522 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:14.182128 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:14.319475 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:14.327853 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2fbff3f0-4fef-43c6-9405-b195a3a33f63 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.167914 Oct 17 18:08:14.328691 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 570/1163] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:14 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:15.353712 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:15.354435 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:15.360526 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:15.360875 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:15.361295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:15.361971 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:15.362402 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:15.362997 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:15.504291 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:15.512020 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-685a6239-4d92-4941-9a58-76b3c44e53e7 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1260 microversion: 2.1 time: 0.164359 Oct 17 18:08:15.512822 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 594/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:15 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:16.535238 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:16.536081 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:16.544147 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:16.544654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:16.545093 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:16.546408 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:16.546868 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:16.547295 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:16.678866 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:16.686989 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1c5a130b-f515-4678-853d-ba66dc485484 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1444 microversion: 2.1 time: 0.155774 Oct 17 18:08:16.687548 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 571/1165] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:16 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:16.713738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:08:16.713738 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:08:16.718928 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:16.719408 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:16.719836 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:16.720517 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:16.720987 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:16.721429 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:16.861569 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:08:16.870695 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-5758ea73-ce33-44e6-96dc-13ba0b6d3950 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1444 microversion: 2.1 time: 0.163913 Oct 17 18:08:16.871285 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 595/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:08:16 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:08:19.257879 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-77a8d264-c3b2-419b-a98b-1c8347d5ca5d req-205c85ac-9b60-44c8-8eaf-8614345391c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:08:19.267737 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-77a8d264-c3b2-419b-a98b-1c8347d5ca5d req-205c85ac-9b60-44c8-8eaf-8614345391c6 service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:08:19.271168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-77a8d264-c3b2-419b-a98b-1c8347d5ca5d req-205c85ac-9b60-44c8-8eaf-8614345391c6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:08:19.271168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-77a8d264-c3b2-419b-a98b-1c8347d5ca5d req-205c85ac-9b60-44c8-8eaf-8614345391c6 service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:08:19.283069 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.compute.server_external_events [req-77a8d264-c3b2-419b-a98b-1c8347d5ca5d req-205c85ac-9b60-44c8-8eaf-8614345391c6 service nova] Creating event network-changed:22a1b38e-04f6-4fe1-9f34-1d89c72c03fe for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 on hv-cinder-86160 Oct 17 18:08:19.289812 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-77a8d264-c3b2-419b-a98b-1c8347d5ca5d req-205c85ac-9b60-44c8-8eaf-8614345391c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172786 Oct 17 18:08:19.290462 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 572/1167] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:10:13.355370 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=30 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:10:13.356133 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=58 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:10:13.357294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 18:10:13.357447 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: Mon Oct 17 18:10:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838/action (ip 10.222.0.58) !!! Oct 17 18:10:13.362990 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:10:13.363488 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:13.371231 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:13.371720 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:13.372157 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:13.372876 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:13.373333 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:13.373757 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:13.398232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lazy-loading 'flavor' on Instance uuid 3c50670e-6ad5-4075-8fab-5a7f34f50838 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:10:13.701808 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-e04a05d0-1f9b-4cb1-acf6-98c4d9ee4a50 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "POST /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838/action" status: 202 len: 0 microversion: 2.1 time: 0.348160 Oct 17 18:10:13.702642 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 596/1168] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:10:13 2022] POST /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:10:13.710100 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75add44a-2039-478e-a309-5185fe853a53] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 18:10:13.711187 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 18:10:13.711318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Mon Oct 17 18:10:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 (ip 10.222.0.58) !!! Oct 17 18:10:13.712821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:10:13.713569 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=64 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:10:13.721449 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:13.723909 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:13.730835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:13.731318 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:13.731766 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:13.732444 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:13.732933 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:13.733390 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:13.868907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:13.876783 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-97dbed23-ca8b-4c84-a4a0-16ea6edc7b18 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.168430 Oct 17 18:10:13.877881 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 573/1169] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:13 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:14.902286 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:14.902983 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:14.909292 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:14.909766 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:14.910198 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:14.910877 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:14.911325 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:14.911744 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:15.045222 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:15.053433 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ff129fe8-a444-4780-a938-57c104af974a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.156232 Oct 17 18:10:15.054057 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 597/1170] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:14 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:16.077383 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:16.077939 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:16.087490 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:16.087973 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:16.088410 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:16.089139 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:16.089598 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:16.090033 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:16.093398 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO oslo.messaging._drivers.impl_rabbit [-] [75add44a-2039-478e-a309-5185fe853a53] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 43704. Oct 17 18:10:16.221917 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:16.229649 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-85a46af7-8c0d-4802-8f15-ad35a1703d2a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.156910 Oct 17 18:10:16.230220 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 574/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:16 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:17.253242 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:17.253823 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:17.260140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:17.260630 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:17.261074 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:17.261735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:17.262176 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:17.262590 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:17.397340 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:17.404996 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7ee74312-441c-48ec-a0ba-2bdc9562944a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.156282 Oct 17 18:10:17.405554 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 598/1172] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:17 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:18.429599 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:18.430210 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:18.436879 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:18.437359 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:18.437801 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:18.438488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:18.438942 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:18.439369 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:18.566891 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:18.574539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-2d610212-c817-473c-b3ac-dff6978b1ec5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.148949 Oct 17 18:10:18.575111 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 575/1173] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:18 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:19.597694 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:19.598439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:19.604636 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:19.605112 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:19.605534 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:19.606209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:19.606651 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:19.607097 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:19.736538 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:19.744411 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-b4960ce8-d930-43eb-95bc-877277880423 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.151522 Oct 17 18:10:19.744998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 599/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:19 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:20.767740 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:20.768386 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:20.774799 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:20.775285 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:20.775730 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:20.776420 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:20.776900 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:20.777326 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:20.905036 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:20.913550 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-31f8ccee-e725-492d-be19-f3f15c435fd4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.149704 Oct 17 18:10:20.914132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 576/1175] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:20 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:21.937567 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:21.937969 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:21.945170 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:21.945765 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:21.946199 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:21.946894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:21.947338 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:21.947789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:22.164615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:22.172321 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-977f539f-8b6a-4930-a66f-ea7230db2735 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.238910 Oct 17 18:10:22.172944 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 600/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:21 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:23.195999 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:23.196625 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:23.203101 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:23.203575 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:23.204005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:23.204702 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:23.205157 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:23.205652 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:23.335366 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:23.343027 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-f5eeecfa-aa9b-4c2e-bcc6-1537dc065718 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.150888 Oct 17 18:10:23.343605 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 577/1177] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:23 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:24.367201 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:24.367886 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:24.374424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:24.374895 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:24.375324 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:24.376033 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:24.376475 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:24.376913 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:24.584736 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:24.592406 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0a07282d-42e0-42fa-9021-ff74a30a65cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.229682 Oct 17 18:10:24.593129 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 601/1178] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:24 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:25.617912 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:25.618518 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:25.624974 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:25.625438 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:25.625860 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:25.626539 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:25.626980 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:25.627397 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:25.759305 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:25.766935 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cda622da-9fa7-429b-b661-4f8d0cfe87a5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.153448 Oct 17 18:10:25.773098 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 578/1179] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:25 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:26.792041 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:26.792773 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:26.798777 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:26.799260 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:26.799697 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:26.800464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:26.801512 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:26.802104 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:26.935582 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:26.944140 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-47b62560-cfe6-42e5-ab65-b1fe7f30750c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1568 microversion: 2.1 time: 0.156165 Oct 17 18:10:26.944719 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 602/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:26 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:27.967676 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:27.968282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:27.975627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:27.976108 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:27.976540 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:27.977308 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:27.977755 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:27.978180 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:28.115710 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:28.123888 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-63acd274-424c-44a9-9ea3-47b5edf61d5c tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1509 microversion: 2.1 time: 0.160053 Oct 17 18:10:28.124450 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 579/1181] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:27 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:28.148192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:10:28.149397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:28.155870 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:28.156561 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:28.157151 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:28.157752 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:28.158192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:28.158602 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:28.291192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126519) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 18:10:28.596407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-0cf06b24-171d-40d9-9aa7-49584ed11f4a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "POST /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838/action" status: 202 len: 0 microversion: 2.1 time: 0.452759 Oct 17 18:10:28.596983 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 603/1182] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 17 18:10:28 2022] POST /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 18:10:28.605821 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:28.606473 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:28.618440 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:28.618932 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:28.619374 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:28.620080 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:28.620582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:28.625813 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:28.755658 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:28.763556 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-8f407afa-5a0b-4feb-a618-1c1734e1f2e2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1517 microversion: 2.1 time: 0.161610 Oct 17 18:10:28.764132 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 580/1183] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:28 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:29.788490 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:29.789153 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:29.795243 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:29.795734 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:29.796178 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:29.796905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:29.797362 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:29.797785 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:29.929829 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:29.937894 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-14081f7c-12f7-4e7b-8e45-1af170c26c4f tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1519 microversion: 2.1 time: 0.154236 Oct 17 18:10:29.940895 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 604/1184] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:29 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:30.533709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [req-42278333-24ba-447d-93f5-7546a0ecea9e req-ccd9768c-930a-42e7-a2a0-f16db5371abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "name": "network-vif-unplugged", "status": "completed", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:10:30.544748 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-42278333-24ba-447d-93f5-7546a0ecea9e req-ccd9768c-930a-42e7-a2a0-f16db5371abc service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:30.545297 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-42278333-24ba-447d-93f5-7546a0ecea9e req-ccd9768c-930a-42e7-a2a0-f16db5371abc service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:30.545733 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [req-42278333-24ba-447d-93f5-7546a0ecea9e req-ccd9768c-930a-42e7-a2a0-f16db5371abc service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:30.558038 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.compute.server_external_events [req-42278333-24ba-447d-93f5-7546a0ecea9e req-ccd9768c-930a-42e7-a2a0-f16db5371abc service nova] Unable to find a host for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838. Dropping event network-vif-unplugged {{(pid=126522) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 18:10:30.558908 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [req-42278333-24ba-447d-93f5-7546a0ecea9e req-ccd9768c-930a-42e7-a2a0-f16db5371abc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029091 Oct 17 18:10:30.559489 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 581/1185] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 18:10:30.961811 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:30.962422 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:30.968783 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:30.969253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:30.969681 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:30.970353 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:30.970795 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:30.971209 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:31.107514 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:31.115860 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a64e5c95-b5e2-4500-8f88-17c94ce28cbd tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1519 microversion: 2.1 time: 0.157961 Oct 17 18:10:31.116424 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 605/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:30 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:32.140092 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:32.140670 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:32.147296 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:32.147770 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:32.148208 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:32.148935 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:32.149390 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:32.149819 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:32.283005 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:32.290966 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-41eab97b-f2bf-498a-aaf4-efa574fc35f2 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.154842 Oct 17 18:10:32.291530 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 582/1187] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:32 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:33.314583 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:33.315192 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:33.321702 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:33.322183 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:33.322615 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:33.323301 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:33.323753 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:33.324175 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:33.454903 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:33.462721 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ec85f38b-de51-4660-ab44-32025dde9918 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.152263 Oct 17 18:10:33.463294 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 606/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:33 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:34.486181 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:34.486777 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:34.493315 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:34.493785 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:34.494213 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:34.494893 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:34.495336 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:34.495756 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:34.629698 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:34.637595 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-29e5f0f5-588d-431b-80d7-7aae5fb6dba8 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.155295 Oct 17 18:10:34.638168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 583/1189] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:34 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:35.661498 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:35.662123 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:35.668659 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:35.669131 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:35.669556 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:35.670232 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:35.670673 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:35.671087 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:35.802515 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:35.810438 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-ce056e57-32ca-467c-900e-a29b88831bb3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.153449 Oct 17 18:10:35.811003 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 607/1190] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:35 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:36.833019 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:36.833626 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:36.839907 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:36.840381 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:36.840840 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:36.841520 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:36.841965 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:36.842387 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:36.973674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:36.981709 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-cba3f2f7-2ee3-4f53-990b-4ab7ff6b7bae tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.152725 Oct 17 18:10:36.982324 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 584/1191] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:36 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:38.004798 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:38.005439 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:38.011742 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:38.012226 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:38.012690 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:38.013381 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:38.013833 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:38.014256 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:38.149910 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:38.154989 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-29414985-6ec4-425d-8fbc-fbfae0b1c798 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.154161 Oct 17 18:10:38.155557 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 608/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:37 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:39.180010 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:39.180713 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:39.187432 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:39.187903 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:39.188329 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:39.189114 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:39.189587 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:39.190017 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:39.326401 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:39.331082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-ae50bba2-93b0-4514-a337-d124b0bd89cf tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.156011 Oct 17 18:10:39.331664 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 585/1193] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:39 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:40.354802 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:40.355407 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:40.361718 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:40.362199 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:40.362700 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:40.363397 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:40.363998 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:40.364299 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:40.383665 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:10:40.500629 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:40.509111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-7b75e601-007c-43df-97d6-1aebfb1d6efc tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.158238 Oct 17 18:10:40.509672 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 609/1194] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:40 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:41.533279 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:41.533887 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:41.540722 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:41.541200 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:41.541634 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:41.542323 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:41.542772 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:41.543198 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:41.673097 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:41.680869 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-92621680-0b72-4856-a01b-691d97a8246b tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.151501 Oct 17 18:10:41.681470 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 586/1195] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:41 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:42.464016 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-043f8002-4ac1-4f9e-aaa1-bc68ba904baf req-daa0f7ba-7da1-41e6-aa11-b9b2c8c1bf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "name": "network-vif-plugged", "status": "completed", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:10:42.474010 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-043f8002-4ac1-4f9e-aaa1-bc68ba904baf req-daa0f7ba-7da1-41e6-aa11-b9b2c8c1bf8c service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:42.474483 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-043f8002-4ac1-4f9e-aaa1-bc68ba904baf req-daa0f7ba-7da1-41e6-aa11-b9b2c8c1bf8c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:42.474905 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-043f8002-4ac1-4f9e-aaa1-bc68ba904baf req-daa0f7ba-7da1-41e6-aa11-b9b2c8c1bf8c service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:42.485830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-043f8002-4ac1-4f9e-aaa1-bc68ba904baf req-daa0f7ba-7da1-41e6-aa11-b9b2c8c1bf8c service nova] Creating event network-vif-plugged:22a1b38e-04f6-4fe1-9f34-1d89c72c03fe for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 on hv-cinder-86160 Oct 17 18:10:42.491227 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-043f8002-4ac1-4f9e-aaa1-bc68ba904baf req-daa0f7ba-7da1-41e6-aa11-b9b2c8c1bf8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030812 Oct 17 18:10:42.491848 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 610/1196] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:10:42.704109 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:42.704798 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:42.711334 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:42.711852 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:42.712245 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:42.712969 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:42.713430 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:42.713859 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:42.910255 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:42.919749 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-fff6ef7f-dbdf-46e4-8ea9-621c68338ce5 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1575 microversion: 2.1 time: 0.219425 Oct 17 18:10:42.920353 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 587/1197] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:42 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:10:43.945253 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:10:43.945946 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:10:43.947898 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:10:43.952782 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:43.953261 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:43.953691 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:43.954377 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:10:43.954829 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:10:43.955247 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:10:44.090255 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:10:44.098113 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-d4f59dd8-4ad9-4dcf-ad50-d0675db82c59 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1562 microversion: 2.1 time: 0.158466 Oct 17 18:10:44.098731 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 611/1198] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:10:43 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:11:58.126006 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:11:58.129149 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_api:SELECT=1 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:11:58.129634 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG dbcounter [-] [126519] Writing DB stats nova_cell1:SELECT=10 {{(pid=126519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:11:58.130806 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:11:58.133400 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_api:SELECT=30 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:11:58.133914 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG dbcounter [-] [126522] Writing DB stats nova_cell1:SELECT=86 {{(pid=126522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 18:11:58.139751 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:11:58.140692 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:11:58.140988 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:11:58.141673 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:11:58.142135 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:11:58.142558 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:11:58.173784 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Going to try to terminate instance {{(pid=126522) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 18:11:58.196418 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-49d84690-2b20-4d8d-8486-1ed41cb3f230 req-3ce888aa-a209-41ba-9538-79a1dd9dc05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:11:58.206897 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-49d84690-2b20-4d8d-8486-1ed41cb3f230 req-3ce888aa-a209-41ba-9538-79a1dd9dc05e service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:11:58.207462 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-49d84690-2b20-4d8d-8486-1ed41cb3f230 req-3ce888aa-a209-41ba-9538-79a1dd9dc05e service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:11:58.207986 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-49d84690-2b20-4d8d-8486-1ed41cb3f230 req-3ce888aa-a209-41ba-9538-79a1dd9dc05e service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:11:58.225367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-49d84690-2b20-4d8d-8486-1ed41cb3f230 req-3ce888aa-a209-41ba-9538-79a1dd9dc05e service nova] Creating event network-changed:22a1b38e-04f6-4fe1-9f34-1d89c72c03fe for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 on hv-cinder-86160 Oct 17 18:11:58.225367 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-49d84690-2b20-4d8d-8486-1ed41cb3f230 req-3ce888aa-a209-41ba-9538-79a1dd9dc05e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106776 Oct 17 18:11:58.225883 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 612/1199] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:11:58.411266 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [4809c70d-31b7-4fec-86b7-246468639253] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 18:11:59.419592 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [4809c70d-31b7-4fec-86b7-246468639253] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 43804. Oct 17 18:11:59.499923 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-1b4e3922-0fc5-4e84-8d52-d3a57cd186b0 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 204 len: 0 microversion: 2.1 time: 1.384151 Oct 17 18:11:59.500500 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 588/1200] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 17 18:11:58 2022] DELETE /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 0 bytes in 1386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 18:11:59.509819 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:11:59.510509 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:11:59.517400 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:11:59.517867 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:11:59.518293 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:11:59.518972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:11:59.519416 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:11:59.519830 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:11:59.702816 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:11:59.710555 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-f9db5f3d-74a6-401d-aff7-6760ed79b3e1 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1450 microversion: 2.1 time: 0.205576 Oct 17 18:11:59.711124 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 613/1201] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:11:59 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:12:00.735573 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:12:00.736263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:12:00.742537 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:00.743007 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:00.743436 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:00.744110 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:00.744555 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:00.744996 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:00.926806 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:12:00.934839 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-d06f5e61-6d4e-4337-85d6-a8c690d0a7b3 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1450 microversion: 2.1 time: 0.204207 Oct 17 18:12:00.935582 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 589/1202] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:12:00 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1450 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:12:01.703670 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [req-ec16a69f-2108-4f5f-90aa-42b1208aecd4 req-189a1ddd-ab05-4741-aedd-4fd04a1f3a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c50670e-6ad5-4075-8fab-5a7f34f50838", "name": "network-vif-deleted", "tag": "22a1b38e-04f6-4fe1-9f34-1d89c72c03fe"}]} {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 18:12:01.713265 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-ec16a69f-2108-4f5f-90aa-42b1208aecd4 req-189a1ddd-ab05-4741-aedd-4fd04a1f3a9d service nova] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:01.713735 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-ec16a69f-2108-4f5f-90aa-42b1208aecd4 req-189a1ddd-ab05-4741-aedd-4fd04a1f3a9d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:01.714162 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [req-ec16a69f-2108-4f5f-90aa-42b1208aecd4 req-189a1ddd-ab05-4741-aedd-4fd04a1f3a9d service nova] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:01.724855 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.compute.server_external_events [req-ec16a69f-2108-4f5f-90aa-42b1208aecd4 req-189a1ddd-ab05-4741-aedd-4fd04a1f3a9d service nova] Creating event network-vif-deleted:22a1b38e-04f6-4fe1-9f34-1d89c72c03fe for instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 on hv-cinder-86160 Oct 17 18:12:01.729728 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [req-ec16a69f-2108-4f5f-90aa-42b1208aecd4 req-189a1ddd-ab05-4741-aedd-4fd04a1f3a9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Oct 17 18:12:01.730317 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 614/1203] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 17 18:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 18:12:01.958072 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:12:01.958654 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:12:01.965231 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:01.967350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:01.967350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:01.967350 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:01.967687 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:01.967835 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:02.036627 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.policy [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126522) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:12:02.045234 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-dbaae6ac-71fe-45f1-888e-8a1737001e98 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1219 microversion: 2.1 time: 0.090525 Oct 17 18:12:02.045827 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 590/1204] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:12:01 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:12:03.069625 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:12:03.070319 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.compute.api [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126519) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:12:03.076464 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:03.076972 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:03.077404 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:03.078098 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:03.078551 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:03.078974 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:03.110204 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:03.110682 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:03.111111 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG oslo_concurrency.lockutils [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:03.111552 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.objects.instance [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lazy-loading 'fault' on Instance uuid 3c50670e-6ad5-4075-8fab-5a7f34f50838 {{(pid=126519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 18:12:03.157853 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.policy [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9b0dca1ad744b9974173b777dc6b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc7c3bfaf5640d4a68b7e6361c16c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126519) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 18:12:03.166063 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-a36ae9a0-8e56-471c-a1e3-02f4c9f4c16a tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 200 len: 1224 microversion: 2.1 time: 0.101171 Oct 17 18:12:03.166638 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 615/1205] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:12:03 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 18:12:04.190642 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '>' {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:12:04.191250 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.compute.api [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [instance: 3c50670e-6ad5-4075-8fab-5a7f34f50838] Fetching instance by UUID {{(pid=126522) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 18:12:04.197560 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:04.198058 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:04.198488 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:04.199168 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Acquiring lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 18:12:04.199612 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 18:12:04.200029 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG oslo_concurrency.lockutils [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Lock "055a56ef-b612-4d83-a035-3bdaaf8bd0d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 18:12:04.213674 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.wsgi [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] HTTP exception thrown: Instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 could not be found. Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Request method failure captured: Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: request: GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 HTTP/1.1 Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept: application/json Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Accept-Encoding: identity Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Connection: close Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Length: 0 Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Content-Type: application/json Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Host: 10.222.0.58 Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: Openstack-System-Scope: None Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: User-Agent: python-urllib3/1.26.12 Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Auth-Token: gAAAAABjTZnax_hVLtsjNugQRMzyZvTKHttJhdSEvyPx9kEo3Er0GTmJ1KcZxQIUsfkO62ySCUZNB4xsLSWMptIzJIbwYAEDJLv842--ahcujAqZal4Rhhe3JHj-wYivR_wplzeyqYJppC77pp0WDp9vz1QCZ0C8VKpGD61AertI5NBWjLFwNdk Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Id: None Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Domain-Name: None Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Identity-Status: Confirmed Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Is-Admin-Project: True Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Id: default Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Domain-Name: Default Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Id: 4fc7c3bfaf5640d4a68b7e6361c16c34 Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Project-Name: tempest-TestShelveInstance-1459703885 Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Role: reader,member Oct 17 18:12:04.215282 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Roles: reader,member Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4fc7c3bfaf5640d4a68b7e6361c16c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4fc7c3bfaf5640d4a68b7e6361c16c34", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4fc7c3bfaf5640d4a68b7e6361c16c34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4fc7c3bfaf5640d4a68b7e6361c16c34"}]}] Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant: tempest-TestShelveInstance-1459703885 Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Id: 4fc7c3bfaf5640d4a68b7e6361c16c34 Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-Tenant-Name: tempest-TestShelveInstance-1459703885 Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User: tempest-TestShelveInstance-1459703885-project Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Id: default Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Domain-Name: Default Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Id: fd9b0dca1ad744b9974173b777dc6b54 Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: X-User-Name: tempest-TestShelveInstance-1459703885-project Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: method: > Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: exception: Instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 could not be found. Oct 17 18:12:04.217170 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: action_args: {'id': '3c50670e-6ad5-4075-8fab-5a7f34f50838'} Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: {{(pid=126522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 could not be found. Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 18:12:04.218263 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 could not be found. Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 could not be found. Oct 17 18:12:04.220082 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: ERROR nova.api.openstack.wsgi Oct 17 18:12:04.221778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: DEBUG nova.api.openstack.wsgi [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Returning 404 to user: Instance 3c50670e-6ad5-4075-8fab-5a7f34f50838 could not be found. {{(pid=126522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 18:12:04.221778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: INFO nova.api.openstack.requestlog [None req-34e36b0d-3602-4bbc-b485-39c9d65ac959 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838" status: 404 len: 111 microversion: 2.1 time: 0.030667 Oct 17 18:12:04.221778 dv-cinder-861609-1-iscsi devstack@n-api.service[126522]: [pid: 126522|app: 0|req: 591/1206] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 17 18:12:04 2022] GET /compute/v2.1/servers/3c50670e-6ad5-4075-8fab-5a7f34f50838 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 18:12:04.447449 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: DEBUG nova.api.openstack.wsgi [None req-02b0c0a5-603e-48a8-b4f1-b6f920775ab4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] Calling method '.version_select at 0x7f0196280ee0>' {{(pid=126519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 18:12:04.451842 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-02b0c0a5-603e-48a8-b4f1-b6f920775ab4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [ea2dcf75-167a-449d-b4e0-1de86d43871e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 18:12:05.460295 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO oslo.messaging._drivers.impl_rabbit [None req-02b0c0a5-603e-48a8-b4f1-b6f920775ab4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] [ea2dcf75-167a-449d-b4e0-1de86d43871e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 43830. Oct 17 18:12:05.529482 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: INFO nova.api.openstack.requestlog [None req-02b0c0a5-603e-48a8-b4f1-b6f920775ab4 tempest-TestShelveInstance-1459703885 tempest-TestShelveInstance-1459703885-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1336473504" status: 202 len: 0 microversion: 2.1 time: 1.085782 Oct 17 18:12:05.530789 dv-cinder-861609-1-iscsi devstack@n-api.service[126519]: [pid: 126519|app: 0|req: 616/1207] 10.222.0.58 () {58 vars in 1254 bytes} [Mon Oct 17 18:12:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1336473504 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)